Sep 18 21:50:34 devstack cinder-volume[75380]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 21:50:34 devstack cinder-volume[75380]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 21:50:34 devstack cinder-volume[75380]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 21:50:36 devstack cinder-volume[75380]: INFO dbcounter [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Registered counter for database cinder
Sep 18 21:50:36 devstack cinder-volume[75380]: DEBUG oslo_db.sqlalchemy.engines [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 21:50:36 devstack cinder-volume[75380]: DEBUG dbcounter [-] [75380] Writer thread running {{(pid=75380) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 21:50:36 devstack cinder-volume[75380]: INFO cinder.rpc [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 18 21:50:36 devstack cinder-volume[75380]: INFO cinder.rpc [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 18 21:50:36 devstack cinder-volume[75380]: DEBUG oslo_db.sqlalchemy.engines [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 21:50:36 devstack cinder-volume[75380]: INFO cinder.volume.manager [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Determined volume DB was empty at startup.
Sep 18 21:50:36 devstack cinder-volume[75380]: DEBUG cinder.volume.manager [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75380) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 18 21:50:36 devstack cinder-volume[75380]: INFO cinder.volume.manager [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 18 21:50:36 devstack cinder-volume[75380]: WARNING stevedore.named [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 18 21:50:36 devstack cinder-volume[75380]: WARNING castellan.key_manager [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 21:50:36 devstack cinder-volume[75380]: WARNING cinder.keymgr.conf_key_mgr [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 21:50:36 devstack cinder-volume[75380]: DEBUG cinder.volume.drivers.lvm [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75380) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 18 21:50:36 devstack cinder-volume[75380]: DEBUG oslo_concurrency.processutils [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:37 devstack cinder-volume[75380]: DEBUG oslo_concurrency.processutils [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] CMD "cinder-rtstool verify" returned: 0 in 1.021s {{(pid=75380) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:50:37 devstack cinder-volume[75380]: DEBUG oslo_db.sqlalchemy.engines [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 21:50:38 devstack cinder-volume[75380]: INFO cinder.rpc [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 18 21:50:38 devstack cinder-volume[75380]: INFO cinder.rpc [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 18 21:50:38 devstack cinder-volume[75380]: WARNING stevedore.named [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 18 21:50:38 devstack cinder-volume[75380]: WARNING castellan.key_manager [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 21:50:38 devstack cinder-volume[75380]: INFO cinder.volume.manager [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_db.sqlalchemy.engines [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 21:50:38 devstack cinder-volume[75380]: INFO oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Starting 1 workers
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Started child 75481 {{(pid=75380) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Full set of CONF: {{(pid=75380) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] ******************************************************************************** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Configuration options gathered from: {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] ================================================================================ {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] allow_availability_zone_fallback = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] allow_compression_on_image_upload = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] allowed_direct_url_schemes     = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] api_rate_limit                 = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] auth_strategy                  = keystone {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] az_cache_duration              = 3600 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_availability_zone      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_host                   = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_name                   = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_stats_polling_interval = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backup_api_class               = cinder.backup.api.API {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backup_name_template           = backup-%s {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backup_use_same_host           = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backup_use_temp_snapshot       = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] chap_password                  = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] chap_username                  =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cinder_internal_tenant_project_id = 21a6bca8da0e4d3bbda13b306b9aa594 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cinder_internal_tenant_user_id = 54c8cc667cb643afa26eacfa90b8a7e2 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cloned_volume_same_az          = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cluster                        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] compression_format             = gzip {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] compute_api_class              = cinder.compute.nova.API {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] config_dir                     = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] config_source                  = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] control_exchange               = openstack {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] debug                          = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] default_availability_zone      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] default_group_type             = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] default_volume_type            = lvmdriver-1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] driver_client_cert             = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] driver_client_cert_key         = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] driver_data_namespace          = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] driver_ssl_cert_path           = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] driver_ssl_cert_verify         = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] driver_use_ssl                 = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] enable_force_upload            = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] enable_new_services            = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] enable_unsupported_driver      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] enforce_multipath_for_image_xfer = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] filter_function                = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance_api_insecure            = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance_api_servers             = ['http://192.168.122.85/image'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance_api_ssl_compression     = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance_ca_certificates_file    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance_catalog_info            = image:glance:publicURL {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance_certfile                = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance_keyfile                 = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance_num_retries             = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance_request_timeout         = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] goodness_function              = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] graceful_shutdown_timeout      = 5 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] group_api_class                = cinder.group.api.API {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] host                           = devstack {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] image_compress_on_upload       = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] image_conversion_address_space_limit = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] image_conversion_cpu_limit     = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75481]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] image_conversion_disable       = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] image_upload_use_cinder_backend = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] image_upload_use_internal_tenant = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] image_volume_cache_enabled     = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] image_volume_cache_max_count   = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] image_volume_cache_max_size_gb = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] init_host_max_objects_retrieval = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] instance_format                = [instance: %(uuid)s]  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] iscsi_iotype                   = fileio {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] iscsi_target_flags             =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] iscsi_write_cache              = on {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] iser_helper                    = tgtadm {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] iser_ip_address                = 192.168.122.85 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] iser_port                      = 3260 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] log_color                      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] log_config_append              = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] log_dir                        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] log_file                       = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] log_options                    = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] log_rotate_interval            = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] log_rotate_interval_type       = days {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] log_rotation_type              = none {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] max_age                        = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] max_logfile_count              = 30 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] max_logfile_size_mb            = 200 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] max_over_subscription_ratio    = 20.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] message_reap_interval          = 86400 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] message_ttl                    = 2592000 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] migration_create_volume_timeout_secs = 300 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] monkey_patch                   = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] monkey_patch_modules           = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] my_ip                          = 192.168.122.85 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] no_snapshot_gb_quota           = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] num_iser_scan_tries            = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] num_shell_tries                = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] num_volume_device_scan_tries   = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] nvmeof_conn_info_version       = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] nvmet_ns_id                    = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] nvmet_port_id                  = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] osapi_max_limit                = 1000 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] osapi_volume_ext_list          = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] osapi_volume_listen_port       = 8776 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] osapi_volume_use_ssl           = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] osapi_volume_workers           = 2 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] per_volume_size_limit          = -1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] periodic_fuzzy_delay           = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] periodic_interval              = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] public_endpoint                = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] publish_errors                 = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] quota_backup_gigabytes         = 1000 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] quota_backups                  = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] quota_gigabytes                = 1000 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] quota_groups                   = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] quota_snapshots                = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] quota_volumes                  = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] rate_limit_burst               = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] rate_limit_except_level        = CRITICAL {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] rate_limit_interval            = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] reinit_driver_count            = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] replication_device             = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] report_discard_supported       = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] report_interval                = 120 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] reservation_clean_interval     = 86400 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] reservation_expire             = 86400 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] reserved_image_namespaces      = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] reserved_percentage            = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] rpc_response_timeout           = 120 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] run_external_periodic_tasks    = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] scst_target_driver             = iscsi {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] scst_target_iqn_name           = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] service_down_time              = 720 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] shell_completion               = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] snapshot_name_template         = snapshot-%s {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] snapshot_same_host             = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] split_loggers                  = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] state_path                     = /opt/stack/data/cinder {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] storage_availability_zone      = nova {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] storage_protocol               = iSCSI {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] syslog_log_facility            = LOG_USER {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] target_helper                  = lioadm {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] target_ip_address              = 192.168.122.85 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] target_port                    = 3260 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] target_protocol                = iscsi {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] target_secondary_ip_addresses  = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] trace_flags                    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] transport_url                  = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] until_refresh                  = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] use_chap_auth                  = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] use_default_quota_class        = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] use_journal                    = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] use_json                       = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] use_multipath_for_image_xfer   = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] use_stderr                     = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] use_syslog                     = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] verify_glance_signatures       = enabled {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] volume_api_class               = cinder.volume.api.API {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] volume_backend_name            = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] volume_clear                   = zero {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] volume_clear_ionice            = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] volume_clear_size              = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] volume_copy_bps_limit          = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] volume_dd_blocksize            = 1M {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] volume_name_template           = volume-%s {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] volume_service_inithost_offload = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] volume_usage_audit_period      = month {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] watch_log_file                 = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] zoning_mode                    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_concurrency.disable_process_locking = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.admin_password = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.admin_token = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.admin_user  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.auth_admin_prefix =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.auth_port   = 35357 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.auth_protocol = https {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.auth_section = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.auth_type   = password {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.auth_uri    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.auth_version = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.cache       = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.certfile    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.delay_auth_decision = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.http_connect_timeout = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.identity_uri = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.include_service_catalog = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.insecure    = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.interface   = public {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.keyfile     = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_password =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcache_username =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.region_name = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.service_token_roles_required = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.service_type = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.token_cache_time = 300 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.backend                  = dogpile.cache.null {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.backend_argument         = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.backend_expiration_time  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.config_prefix            = cache.oslo {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.dead_timeout             = 60.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.debug_cache_backend      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.enable_retry_client      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.enable_socket_keepalive  = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.enabled                  = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.enforce_fips_mode        = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.expiration_time          = 600 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.hashclient_retry_attempts = 2 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.memcache_dead_retry      = 300 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.memcache_password        = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.memcache_pool_maxsize    = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.memcache_sasl_enabled    = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.memcache_username        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.proxies                  = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.redis_db                 = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.redis_password           = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.redis_sentinel_service_name = mymaster {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.redis_server             = localhost:6379 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.redis_socket_timeout     = 1.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.redis_username           = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.retry_attempts           = 2 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.retry_delay              = 0.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.socket_keepalive_count   = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.socket_keepalive_idle    = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.socket_keepalive_interval = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.tls_allowed_ciphers      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.tls_cafile               = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.tls_certfile             = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.tls_enabled              = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cache.tls_keyfile              = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] coordination.backend_url       = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.asyncio_connection    = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.asyncio_slave_connection = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.backend               = sqlalchemy {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.connection            = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.connection_debug      = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.connection_parameters =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.connection_recycle_time = 3600 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.connection_trace      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.db_inc_retry_interval = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.db_max_retries        = 20 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.db_max_retry_interval = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.db_retry_interval     = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.max_overflow          = 50 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.max_pool_size         = 5 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.max_retries           = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.mysql_wsrep_sync_wait = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.pool_timeout          = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.retry_interval        = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.slave_connection      = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.sqlite_synchronous    = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] database.use_db_reconnect      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] profiler.connection_string     = messaging:// {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] profiler.enabled               = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] profiler.es_doc_type           = notification {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] profiler.es_scroll_size        = 10000 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] profiler.es_scroll_time        = 2m {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] profiler.filter_error_trace    = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] profiler.hmac_keys             = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] profiler.sentinel_service_name = mymaster {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] profiler.socket_timeout        = 0.1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] profiler.trace_requests        = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] profiler.trace_sqlalchemy      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] profiler_jaeger.process_tags   = {} {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] profiler_jaeger.service_name_prefix = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] profiler_otlp.service_name_prefix = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_policy.enforce_new_defaults = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: WARNING oslo_config.cfg [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_policy.enforce_scope      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_policy.policy_default_rule = default {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_policy.policy_file        = policy.yaml {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75481]: INFO cinder.volume.manager [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] privsep_osbrick.group          = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] privsep_osbrick.helper_command = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] privsep_osbrick.user           = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cinder_sys_admin.group         = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cinder_sys_admin.helper_command = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] cinder_sys_admin.user          = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] service_user.auth_section      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] service_user.auth_type         = password {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] service_user.certfile          = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] service_user.collect_timing    = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] service_user.insecure          = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] service_user.keyfile           = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] service_user.send_service_user_token = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] service_user.split_loggers     = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] service_user.timeout           = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance.auth_section            = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance.auth_type               = password {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance.certfile                = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance.collect_timing          = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance.insecure                = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance.keyfile                 = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance.split_loggers           = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] glance.timeout                 = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.backend_availability_zone = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.chap_password = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.chap_username =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.driver_client_cert = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.driver_client_cert_key = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.driver_data_namespace = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.driver_use_ssl = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.enable_unsupported_driver = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.extra_capabilities = {} {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.filter_function = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.goodness_function = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.iscsi_iotype  = fileio {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.iscsi_target_flags =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.iscsi_write_cache = on {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:38 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.iser_helper   = tgtadm {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.iser_ip_address = 192.168.122.85 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.iser_port     = 3260 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.lvm_share_target = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.lvm_type      = auto {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.num_shell_tries = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.nvmet_port_id = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.replication_device = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.report_discard_supported = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.reserved_percentage = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.scst_target_driver = iscsi {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.scst_target_iqn_name = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.storage_protocol = iSCSI {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.target_helper = tgtadm {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.target_ip_address = 192.168.122.85 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.target_port   = 3260 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.target_protocol = iscsi {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.trace_flags   = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.unique_fqdn_network = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.use_chap_auth = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.volume_backend_name = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.volume_clear  = zero {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.volume_clear_ionice = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.volume_clear_size = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_reports.file_event_handler = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_reports.log_dir           = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.backend_availability_zone = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.backend_host       = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.chap_password      = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.chap_username      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.driver_client_cert = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.driver_data_namespace = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.extra_capabilities = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.filter_function    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.goodness_function  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.iscsi_iotype       = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.iser_helper        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.iser_ip_address    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.iser_port          = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.iser_target_prefix = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.lvm_share_target   = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.lvm_type           = auto {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.num_shell_tries    = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.replication_device = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.report_discard_supported = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.reserved_percentage = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.scst_target_driver = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.storage_protocol   = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.target_helper      = lioadm {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.target_ip_address  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.target_port        = 3260 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.trace_flags        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.194s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.use_chap_auth      = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.volume_clear       = zero {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.volume_clear_size  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] lvmdriver-1.volumes_dir        = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.ssl      = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_notifications.driver = [] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_notifications.retry = -1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] oslo_messaging_notifications.transport_url = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] key_manager.fixed_key          = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.barbican_api_version  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.barbican_endpoint     = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.barbican_endpoint_type = public {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.barbican_region_name  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.cafile                = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.certfile              = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.collect_timing        = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.insecure              = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.keyfile               = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.number_of_retries     = 60 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.retry_delay           = 1 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.send_service_user_token = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.split_loggers         = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.timeout               = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.verify_ssl            = True {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican.verify_ssl_path       = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican_service_user.auth_section = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican_service_user.auth_type = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican_service_user.cafile   = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican_service_user.certfile = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican_service_user.collect_timing = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican_service_user.insecure = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican_service_user.keyfile  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican_service_user.split_loggers = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] barbican_service_user.timeout  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] vault.approle_role_id          = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] vault.approle_secret_id        = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] vault.kv_mountpoint            = secret {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] vault.kv_path                  = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] vault.kv_version               = 2 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] vault.namespace                = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] vault.root_token_id            = **** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] vault.ssl_ca_crt_file          = None {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] vault.timeout                  = 60.0 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] vault.use_ssl                  = False {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:50:39 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] ******************************************************************************** {{(pid=75380) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 18 21:50:39 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.140s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:50:39 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:39 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.098s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:50:39 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:39 devstack sudo[75523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 18 21:50:39 devstack sudo[75523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:50:41 devstack sudo[75523]: pam_unix(sudo:session): session closed for user root
Sep 18 21:50:41 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.133s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:50:41 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:41 devstack sudo[75672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 21:50:41 devstack sudo[75672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:50:43 devstack sudo[75672]: pam_unix(sudo:session): session closed for user root
Sep 18 21:50:43 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 2.003s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:50:43 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 21:50:43 devstack cinder-volume[75481]: INFO cinder.brick.local_dev.lvm [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 18 21:50:43 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:43 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.079s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:50:43 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:43 devstack sudo[75768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 21:50:43 devstack sudo[75768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:50:45 devstack sudo[75768]: pam_unix(sudo:session): session closed for user root
Sep 18 21:50:45 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.956s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:50:45 devstack cinder-volume[75481]: DEBUG cinder.brick.local_dev.lvm [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75481) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Sep 18 21:50:45 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:45 devstack sudo[75862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 21:50:45 devstack sudo[75862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:50:48 devstack cinder-volume[75380]: DEBUG dbcounter [-] [75380] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75380) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 21:50:48 devstack sudo[75862]: pam_unix(sudo:session): session closed for user root
Sep 18 21:50:48 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.244s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:50:49 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:49 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.085s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:50:49 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:49 devstack sudo[76052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 21:50:49 devstack sudo[76052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:50:51 devstack sudo[76052]: pam_unix(sudo:session): session closed for user root
Sep 18 21:50:51 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.953s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:50:51 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:51 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.074s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:50:51 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:51 devstack sudo[76085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 18 21:50:51 devstack sudo[76085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:50:53 devstack sudo[76085]: pam_unix(sudo:session): session closed for user root
Sep 18 21:50:53 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.033s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:50:53 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:53 devstack sudo[76121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 21:50:53 devstack sudo[76121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:50:56 devstack sudo[76121]: pam_unix(sudo:session): session closed for user root
Sep 18 21:50:56 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.937s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:50:56 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:56 devstack sudo[76210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 21:50:56 devstack sudo[76210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:50:58 devstack sudo[76210]: pam_unix(sudo:session): session closed for user root
Sep 18 21:50:58 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.215s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:50:58 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:50:58 devstack sudo[76215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:50:58 devstack sudo[76215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:01 devstack sudo[76215]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:01 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.770s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:01 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:01 devstack sudo[76220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 21:51:01 devstack sudo[76220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:03 devstack sudo[76220]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:03 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.483s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:03 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:03 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.110s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:03 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:04 devstack sudo[76226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 21:51:04 devstack sudo[76226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:06 devstack sudo[76226]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:06 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.172s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:06 devstack cinder-volume[75481]: INFO cinder.volume.drivers.lvm [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 18 21:51:06 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:06 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.086s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:06 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:06 devstack sudo[76308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 21:51:06 devstack sudo[76308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:08 devstack sudo[76308]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:08 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.843s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:08 devstack cinder-volume[75481]: DEBUG cinder.volume.drivers.lvm [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Updating volume stats {{(pid=75481) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 21:51:08 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:08 devstack sudo[76374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 21:51:08 devstack sudo[76374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:10 devstack sudo[76374]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:10 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.989s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:10 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:10 devstack sudo[76489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:51:10 devstack sudo[76489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:12 devstack sudo[76489]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:12 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.963s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:12 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:12 devstack sudo[76492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 21:51:12 devstack sudo[76492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:14 devstack sudo[76492]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:14 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.877s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:14 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:14 devstack sudo[76495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:51:14 devstack sudo[76495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:15 devstack sudo[76495]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:15 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.855s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:15 devstack cinder-volume[75481]: INFO cinder.volume.driver [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Driver hasn't implemented _init_vendor_properties()
Sep 18 21:51:15 devstack cinder-volume[75481]: DEBUG cinder.volume.driver [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75481) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 18 21:51:16 devstack cinder-volume[75481]: DEBUG oslo_db.sqlalchemy.engines [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75481) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 21:51:16 devstack cinder-volume[75481]: DEBUG dbcounter [-] [75481] Writer thread running {{(pid=75481) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 21:51:16 devstack cinder-volume[75481]: DEBUG cinder.db.sqlalchemy.api [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Building query based on filter {{(pid=75481) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 18 21:51:16 devstack cinder-volume[75481]: DEBUG cinder.image.image_utils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75481) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 18 21:51:16 devstack cinder-volume[75481]: INFO cinder.keymgr.migration [None req-7ff15bd2-fcf3-4dff-962a-da64062954d7 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 18 21:51:16 devstack cinder-volume[75481]: DEBUG cinder.volume.drivers.lvm [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Updating volume stats {{(pid=75481) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 21:51:16 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:16 devstack sudo[76503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 21:51:16 devstack sudo[76503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:18 devstack sudo[76503]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:18 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.794s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:18 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:18 devstack sudo[76527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:51:18 devstack sudo[76527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:20 devstack sudo[76527]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:20 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.949s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:20 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:20 devstack sudo[76634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 21:51:20 devstack sudo[76634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:22 devstack sudo[76634]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:22 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.950s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:22 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:22 devstack sudo[76653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:51:22 devstack sudo[76653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:24 devstack sudo[76653]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:24 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.998s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:24 devstack cinder-volume[75481]: DEBUG cinder.manager [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Notifying Schedulers of capabilities ... {{(pid=75481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 21:51:24 devstack cinder-volume[75481]: INFO cinder.volume.manager [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Driver initialization completed successfully.
Sep 18 21:51:24 devstack cinder-volume[75481]: INFO cinder.manager [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Initiating service 2 cleanup
Sep 18 21:51:24 devstack cinder-volume[75481]: INFO cinder.manager [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Service 2 cleanup completed.
Sep 18 21:51:24 devstack cinder-volume[75481]: DEBUG cinder.service [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Creating RPC server for service cinder-volume {{(pid=75481) start /opt/stack/cinder/cinder/service.py:239}}
Sep 18 21:51:24 devstack cinder-volume[75481]: DEBUG cinder.service [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75481) start /opt/stack/cinder/cinder/service.py:245}}
Sep 18 21:51:24 devstack cinder-volume[75481]: INFO cinder.volume.manager [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 18 21:51:24 devstack cinder-volume[75481]: DEBUG cinder.volume.drivers.lvm [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Updating volume stats {{(pid=75481) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 21:51:24 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:24 devstack sudo[76663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 21:51:24 devstack sudo[76663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:27 devstack sudo[76663]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:27 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.505s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:27 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:27 devstack sudo[76684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:51:27 devstack sudo[76684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:29 devstack sudo[76684]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:29 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.172s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:29 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:29 devstack sudo[76707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 21:51:29 devstack sudo[76707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:31 devstack sudo[76707]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:31 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.898s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:31 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:31 devstack sudo[76714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:51:31 devstack sudo[76714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:33 devstack sudo[76714]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:33 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.815s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:33 devstack cinder-volume[75481]: INFO cinder.volume.manager [None req-b8ac780b-b772-4a58-8458-7f7834d149df None None] Driver post RPC initialization completed successfully.
Sep 18 21:51:34 devstack cinder-volume[75481]: DEBUG dbcounter [-] [75481] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75481) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 21:51:43 devstack cinder-volume[75481]: DEBUG dbcounter [-] [75481] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75481) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 21:51:43 devstack cinder-volume[75481]: DEBUG oslo_service.periodic_task [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75481) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 21:51:43 devstack cinder-volume[75481]: DEBUG cinder.volume.drivers.lvm [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Updating volume stats {{(pid=75481) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 21:51:43 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:43 devstack sudo[76974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 21:51:43 devstack sudo[76974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:45 devstack sudo[76974]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:45 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.993s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:45 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:45 devstack sudo[77012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:51:45 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:47 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:47 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.913s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:47 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:47 devstack sudo[77016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 21:51:47 devstack sudo[77016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:49 devstack sudo[77016]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:49 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.914s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:49 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:51:49 devstack sudo[77082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:51:49 devstack sudo[77082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:51:51 devstack sudo[77082]: pam_unix(sudo:session): session closed for user root
Sep 18 21:51:51 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.954s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:51:51 devstack cinder-volume[75481]: DEBUG cinder.manager [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Notifying Schedulers of capabilities ... {{(pid=75481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 21:52:43 devstack cinder-volume[75481]: DEBUG oslo_service.periodic_task [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75481) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 21:52:43 devstack cinder-volume[75481]: DEBUG cinder.volume.drivers.lvm [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Updating volume stats {{(pid=75481) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 21:52:43 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:52:43 devstack sudo[78097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 21:52:43 devstack sudo[78097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:52:45 devstack sudo[78097]: pam_unix(sudo:session): session closed for user root
Sep 18 21:52:45 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.841s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:52:45 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:52:45 devstack sudo[78103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:52:45 devstack sudo[78103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:52:47 devstack sudo[78103]: pam_unix(sudo:session): session closed for user root
Sep 18 21:52:47 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.837s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:52:47 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:52:47 devstack sudo[78108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 21:52:47 devstack sudo[78108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:52:48 devstack sudo[78108]: pam_unix(sudo:session): session closed for user root
Sep 18 21:52:48 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.922s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:52:49 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:52:49 devstack sudo[78113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:52:49 devstack sudo[78113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:52:50 devstack sudo[78113]: pam_unix(sudo:session): session closed for user root
Sep 18 21:52:50 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.903s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:52:50 devstack cinder-volume[75481]: DEBUG cinder.manager [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Notifying Schedulers of capabilities ... {{(pid=75481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 21:53:43 devstack cinder-volume[75481]: DEBUG oslo_service.periodic_task [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75481) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 21:53:43 devstack cinder-volume[75481]: DEBUG cinder.volume.drivers.lvm [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Updating volume stats {{(pid=75481) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 21:53:43 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:53:43 devstack sudo[78935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 21:53:43 devstack sudo[78935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:53:43 devstack cinder-volume[75481]: DEBUG dbcounter [-] [75481] Writing DB stats cinder:SELECT=1 {{(pid=75481) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 21:53:43 devstack cinder-volume[75481]: DEBUG dbcounter [-] [75481] Writing DB stats cinder:UPDATE=1 {{(pid=75481) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 21:53:45 devstack sudo[78935]: pam_unix(sudo:session): session closed for user root
Sep 18 21:53:45 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.970s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:53:45 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:53:45 devstack sudo[79056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:53:45 devstack sudo[79056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:53:47 devstack sudo[79056]: pam_unix(sudo:session): session closed for user root
Sep 18 21:53:47 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.966s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:53:47 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:53:47 devstack sudo[79060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 21:53:47 devstack sudo[79060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:53:49 devstack sudo[79060]: pam_unix(sudo:session): session closed for user root
Sep 18 21:53:49 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.933s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:53:49 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:53:49 devstack sudo[79063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:53:49 devstack sudo[79063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:53:51 devstack sudo[79063]: pam_unix(sudo:session): session closed for user root
Sep 18 21:53:51 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.894s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:53:51 devstack cinder-volume[75481]: DEBUG cinder.manager [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Notifying Schedulers of capabilities ... {{(pid=75481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 21:54:43 devstack cinder-volume[75481]: DEBUG oslo_service.periodic_task [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75481) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 21:54:43 devstack cinder-volume[75481]: DEBUG cinder.volume.drivers.lvm [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Updating volume stats {{(pid=75481) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 21:54:43 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:54:43 devstack sudo[81612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 21:54:43 devstack sudo[81612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:54:45 devstack sudo[81612]: pam_unix(sudo:session): session closed for user root
Sep 18 21:54:45 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.863s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:54:45 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:54:45 devstack sudo[81615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:54:45 devstack sudo[81615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:54:46 devstack sudo[81615]: pam_unix(sudo:session): session closed for user root
Sep 18 21:54:46 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.688s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:54:46 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:54:47 devstack sudo[81619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 21:54:47 devstack sudo[81619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:54:48 devstack sudo[81619]: pam_unix(sudo:session): session closed for user root
Sep 18 21:54:48 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.716s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:54:48 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:54:48 devstack sudo[81622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:54:48 devstack sudo[81622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:54:50 devstack sudo[81622]: pam_unix(sudo:session): session closed for user root
Sep 18 21:54:50 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.729s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:54:50 devstack cinder-volume[75481]: DEBUG cinder.manager [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Notifying Schedulers of capabilities ... {{(pid=75481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 21:55:43 devstack cinder-volume[75481]: DEBUG oslo_service.periodic_task [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75481) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 21:55:43 devstack cinder-volume[75481]: DEBUG cinder.volume.drivers.lvm [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Updating volume stats {{(pid=75481) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 21:55:43 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:55:43 devstack cinder-volume[75481]: DEBUG dbcounter [-] [75481] Writing DB stats cinder:SELECT=1 {{(pid=75481) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 21:55:43 devstack cinder-volume[75481]: DEBUG dbcounter [-] [75481] Writing DB stats cinder:UPDATE=1 {{(pid=75481) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 21:55:43 devstack sudo[82141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 21:55:43 devstack sudo[82141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:55:45 devstack sudo[82141]: pam_unix(sudo:session): session closed for user root
Sep 18 21:55:45 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.730s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:55:45 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:55:45 devstack sudo[82144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:55:45 devstack sudo[82144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:55:46 devstack sudo[82144]: pam_unix(sudo:session): session closed for user root
Sep 18 21:55:46 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.742s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:55:46 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:55:46 devstack sudo[82149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 21:55:46 devstack sudo[82149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:55:48 devstack sudo[82149]: pam_unix(sudo:session): session closed for user root
Sep 18 21:55:48 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.735s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:55:48 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:55:48 devstack sudo[82155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:55:48 devstack sudo[82155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:55:50 devstack sudo[82155]: pam_unix(sudo:session): session closed for user root
Sep 18 21:55:50 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.816s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:55:50 devstack cinder-volume[75481]: DEBUG cinder.manager [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Notifying Schedulers of capabilities ... {{(pid=75481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 21:56:43 devstack cinder-volume[75481]: DEBUG oslo_service.periodic_task [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75481) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 21:56:43 devstack cinder-volume[75481]: DEBUG cinder.volume.drivers.lvm [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Updating volume stats {{(pid=75481) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 18 21:56:43 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:56:43 devstack sudo[82868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 18 21:56:43 devstack sudo[82868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:56:45 devstack sudo[82868]: pam_unix(sudo:session): session closed for user root
Sep 18 21:56:45 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.251s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:56:45 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:56:45 devstack sudo[82906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:56:45 devstack sudo[82906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:56:47 devstack sudo[82906]: pam_unix(sudo:session): session closed for user root
Sep 18 21:56:47 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.087s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:56:47 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:56:47 devstack sudo[82936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 18 21:56:47 devstack sudo[82936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:56:50 devstack sudo[82936]: pam_unix(sudo:session): session closed for user root
Sep 18 21:56:50 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.835s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:56:50 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:56:50 devstack sudo[82989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 18 21:56:50 devstack sudo[82989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:56:53 devstack sudo[82989]: pam_unix(sudo:session): session closed for user root
Sep 18 21:56:53 devstack cinder-volume[75481]: DEBUG oslo_concurrency.processutils [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.588s {{(pid=75481) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:56:53 devstack cinder-volume[75481]: DEBUG cinder.manager [None req-9f36c245-8abf-4949-9817-3e3c26932d0a None None] Notifying Schedulers of capabilities ... {{(pid=75481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 21:56:57 devstack cinder-volume[75380]: INFO oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Caught SIGTERM, stopping children
Sep 18 21:56:57 devstack cinder-volume[75380]: DEBUG oslo_concurrency.lockutils [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Acquiring lock "singleton_lock" {{(pid=75380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 21:56:57 devstack cinder-volume[75380]: DEBUG oslo_concurrency.lockutils [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Acquired lock "singleton_lock" {{(pid=75380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 21:56:57 devstack cinder-volume[75380]: DEBUG oslo_concurrency.lockutils [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Releasing lock "singleton_lock" {{(pid=75380) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 21:56:57 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Stop services. {{(pid=75380) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 18 21:56:57 devstack cinder-volume[75380]: DEBUG oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Killing children. {{(pid=75380) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 18 21:56:57 devstack cinder-volume[75380]: INFO oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Waiting on 1 children to exit
Sep 18 21:56:59 devstack cinder-volume[75481]: DEBUG oslo_concurrency.lockutils [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Acquiring lock "singleton_lock" {{(pid=75481) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 21:56:59 devstack cinder-volume[75481]: DEBUG oslo_concurrency.lockutils [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Acquired lock "singleton_lock" {{(pid=75481) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 21:56:59 devstack cinder-volume[75481]: DEBUG oslo_concurrency.lockutils [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Releasing lock "singleton_lock" {{(pid=75481) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 21:56:59 devstack cinder-volume[75481]: WARNING amqp [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 18 21:56:59 devstack cinder-volume[75481]: WARNING amqp [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 18 21:56:59 devstack cinder-volume[75380]: INFO oslo_service.backend._eventlet.service [None req-4eb0220c-c13a-4a2b-8aef-e169ca610abd None None] Child 75481 exited with status 0
Sep 18 21:57:16 devstack cinder-volume[83137]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83137) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 18 21:57:16 devstack cinder-volume[83137]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83137) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 18 21:57:16 devstack cinder-volume[83137]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83137) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 18 21:57:20 devstack cinder-volume[83137]: INFO dbcounter [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] Registered counter for database cinder
Sep 18 21:57:20 devstack cinder-volume[83137]: DEBUG oslo_db.sqlalchemy.engines [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83137) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 21:57:20 devstack cinder-volume[83137]: DEBUG dbcounter [-] [83137] Writer thread running {{(pid=83137) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 21:57:20 devstack cinder-volume[83137]: INFO cinder.rpc [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 18 21:57:20 devstack cinder-volume[83137]: INFO cinder.rpc [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 18 21:57:20 devstack cinder-volume[83137]: DEBUG oslo_db.sqlalchemy.engines [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83137) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 21:57:20 devstack cinder-volume[83137]: INFO cinder.volume.manager [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] Determined volume DB was empty at startup.
Sep 18 21:57:20 devstack cinder-volume[83137]: DEBUG cinder.volume.manager [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83137) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 18 21:57:20 devstack cinder-volume[83137]: INFO cinder.volume.manager [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 18 21:57:20 devstack cinder-volume[83137]: WARNING stevedore.named [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 18 21:57:20 devstack cinder-volume[83137]: WARNING castellan.key_manager [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 21:57:20 devstack cinder-volume[83137]: WARNING cinder.keymgr.conf_key_mgr [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 18 21:57:20 devstack cinder-volume[83137]: INFO cinder.volume.manager [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 18 21:57:20 devstack cinder-volume[83137]: DEBUG oslo_db.sqlalchemy.engines [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83137) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 21:57:20 devstack cinder-volume[83137]: INFO oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] Starting 1 workers
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] Started child 83342 {{(pid=83137) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] Full set of CONF: {{(pid=83137) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] ******************************************************************************** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] Configuration options gathered from: {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] ================================================================================ {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] allow_availability_zone_fallback = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83342]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0)
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] allow_compression_on_image_upload = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] allowed_direct_url_schemes     = [] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] api_rate_limit                 = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] auth_strategy                  = keystone {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_availability_zone      = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_host                   = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_name                   = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_stats_polling_interval = 60 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backup_api_class               = cinder.backup.api.API {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backup_name_template           = backup-%s {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backup_use_same_host           = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backup_use_temp_snapshot       = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] chap_password                  = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] chap_username                  =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cinder_internal_tenant_project_id = 21a6bca8da0e4d3bbda13b306b9aa594 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cinder_internal_tenant_user_id = 54c8cc667cb643afa26eacfa90b8a7e2 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cluster                        = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] compression_format             = gzip {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] compute_api_class              = cinder.compute.nova.API {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] config_dir                     = [] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] config_source                  = [] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] control_exchange               = openstack {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] debug                          = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] default_availability_zone      = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] default_group_type             = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] default_volume_type            = QuobyteHD {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] driver_client_cert             = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] driver_client_cert_key         = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] driver_data_namespace          = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] driver_ssl_cert_path           = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] driver_ssl_cert_verify         = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] driver_use_ssl                 = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] enable_new_services            = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] enable_unsupported_driver      = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] enabled_backends               = ['QuobyteHD'] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] enforce_multipath_for_image_xfer = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] filter_function                = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance_api_insecure            = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance_api_servers             = ['http://192.168.122.85/image'] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance_api_ssl_compression     = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance_ca_certificates_file    = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance_catalog_info            = image:glance:publicURL {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance_certfile                = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance_keyfile                 = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance_num_retries             = 3 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance_request_timeout         = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] goodness_function              = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] graceful_shutdown_timeout      = 5 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] group_api_class                = cinder.group.api.API {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] host                           = devstack {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] image_compress_on_upload       = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] image_conversion_address_space_limit = 1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] image_conversion_cpu_limit     = 60 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] image_conversion_disable       = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] image_upload_use_cinder_backend = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] image_upload_use_internal_tenant = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] image_volume_cache_enabled     = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] image_volume_cache_max_count   = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] image_volume_cache_max_size_gb = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] init_host_max_objects_retrieval = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] instance_format                = [instance: %(uuid)s]  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] iscsi_iotype                   = fileio {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] iscsi_target_flags             =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] iscsi_write_cache              = on {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] iser_helper                    = tgtadm {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] iser_ip_address                = 192.168.122.85 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] iser_port                      = 3260 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] log_color                      = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] log_config_append              = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] log_dir                        = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] log_file                       = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] log_options                    = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] log_rotate_interval            = 1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] log_rotate_interval_type       = days {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] log_rotation_type              = none {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] max_age                        = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] max_logfile_count              = 30 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] max_logfile_size_mb            = 200 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] max_over_subscription_ratio    = 20.0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] message_reap_interval          = 86400 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] message_ttl                    = 2592000 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] migration_create_volume_timeout_secs = 300 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] monkey_patch                   = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] monkey_patch_modules           = [] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] my_ip                          = 192.168.122.85 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] no_snapshot_gb_quota           = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] num_iser_scan_tries            = 3 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] num_shell_tries                = 3 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] num_volume_device_scan_tries   = 3 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] nvmeof_conn_info_version       = 1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] nvmet_ns_id                    = 10 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] nvmet_port_id                  = 1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] osapi_max_limit                = 1000 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] osapi_volume_ext_list          = [] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] osapi_volume_listen_port       = 8776 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] osapi_volume_use_ssl           = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] osapi_volume_workers           = 2 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] per_volume_size_limit          = -1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] periodic_fuzzy_delay           = 60 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] periodic_interval              = 60 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] public_endpoint                = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] publish_errors                 = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] quota_backup_gigabytes         = 1000 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] quota_backups                  = 10 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] quota_gigabytes                = 1000 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] quota_groups                   = 10 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] quota_snapshots                = 10 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] quota_volumes                  = 10 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] rate_limit_burst               = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] rate_limit_except_level        = CRITICAL {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] rate_limit_interval            = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] reinit_driver_count            = 3 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] replication_device             = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] report_discard_supported       = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] report_interval                = 120 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] reservation_clean_interval     = 86400 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] reservation_expire             = 86400 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] reserved_image_namespaces      = [] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] reserved_percentage            = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] rpc_response_timeout           = 120 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] run_external_periodic_tasks    = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] scst_target_driver             = iscsi {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] scst_target_iqn_name           = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] service_down_time              = 720 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] shell_completion               = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] snapshot_name_template         = snapshot-%s {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] split_loggers                  = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] state_path                     = /opt/stack/data/cinder {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] storage_availability_zone      = nova {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] storage_protocol               = iSCSI {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] syslog_log_facility            = LOG_USER {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] target_helper                  = lioadm {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] target_ip_address              = 192.168.122.85 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] target_port                    = 3260 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] target_protocol                = iscsi {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] target_secondary_ip_addresses  = [] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] trace_flags                    = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] transport_url                  = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] until_refresh                  = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] use_chap_auth                  = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] use_default_quota_class        = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] use_journal                    = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] use_json                       = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] use_multipath_for_image_xfer   = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] use_stderr                     = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] use_syslog                     = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] verify_glance_signatures       = enabled {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] volume_api_class               = cinder.volume.api.API {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] volume_backend_name            = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] volume_clear                   = zero {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] volume_clear_ionice            = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] volume_clear_size              = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] volume_copy_bps_limit          = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] volume_dd_blocksize            = 1M {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] volume_name_template           = volume-%s {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] volume_service_inithost_offload = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] volume_usage_audit_period      = month {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] watch_log_file                 = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] zoning_mode                    = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_concurrency.disable_process_locking = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.admin_password = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.admin_token = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.admin_user  = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.auth_port   = 35357 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.auth_protocol = https {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.auth_section = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.auth_type   = password {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.auth_uri    = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.auth_version = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.cache       = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.certfile    = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.identity_uri = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.include_service_catalog = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.insecure    = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.interface   = public {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.keyfile     = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_password =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcache_username =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.region_name = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.service_type = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.backend                  = dogpile.cache.null {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.backend_argument         = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.backend_expiration_time  = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.config_prefix            = cache.oslo {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.dead_timeout             = 60.0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.debug_cache_backend      = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.enable_retry_client      = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.enable_socket_keepalive  = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.enabled                  = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.enforce_fips_mode        = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.expiration_time          = 600 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.hashclient_retry_attempts = 2 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.memcache_dead_retry      = 300 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.memcache_password        = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.memcache_pool_maxsize    = 10 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.memcache_sasl_enabled    = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.memcache_username        = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.proxies                  = [] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.redis_db                 = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.redis_password           = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.redis_server             = localhost:6379 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.redis_socket_timeout     = 1.0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.redis_username           = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.retry_attempts           = 2 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.retry_delay              = 0.0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.socket_keepalive_count   = 1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.socket_keepalive_idle    = 1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.socket_keepalive_interval = 1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.tls_allowed_ciphers      = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.tls_cafile               = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.tls_certfile             = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.tls_enabled              = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cache.tls_keyfile              = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] coordination.backend_url       = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.asyncio_connection    = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.asyncio_slave_connection = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.backend               = sqlalchemy {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.connection            = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.connection_debug      = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.connection_parameters =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.connection_recycle_time = 3600 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.connection_trace      = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.db_inc_retry_interval = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.db_max_retries        = 20 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.db_max_retry_interval = 10 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.db_retry_interval     = 1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.max_overflow          = 50 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.max_pool_size         = 5 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.max_retries           = 10 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.mysql_wsrep_sync_wait = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.pool_timeout          = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.retry_interval        = 10 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.slave_connection      = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.sqlite_synchronous    = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] database.use_db_reconnect      = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] profiler.connection_string     = messaging:// {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] profiler.enabled               = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] profiler.es_doc_type           = notification {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] profiler.es_scroll_size        = 10000 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] profiler.es_scroll_time        = 2m {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] profiler.filter_error_trace    = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] profiler.hmac_keys             = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] profiler.sentinel_service_name = mymaster {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] profiler.socket_timeout        = 0.1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] profiler.trace_requests        = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] profiler.trace_sqlalchemy      = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] profiler_jaeger.process_tags   = {} {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] profiler_jaeger.service_name_prefix = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] profiler_otlp.service_name_prefix = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_policy.enforce_new_defaults = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 21:57:21 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 18 21:57:21 devstack cinder-volume[83137]: WARNING oslo_config.cfg [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_policy.enforce_scope      = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_policy.policy_default_rule = default {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83342) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_policy.policy_file        = policy.yaml {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] privsep_osbrick.group          = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] privsep_osbrick.helper_command = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] privsep_osbrick.user           = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cinder_sys_admin.group         = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cinder_sys_admin.helper_command = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] cinder_sys_admin.user          = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] service_user.auth_section      = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] service_user.auth_type         = password {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] service_user.certfile          = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] service_user.collect_timing    = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] service_user.insecure          = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] service_user.keyfile           = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] service_user.send_service_user_token = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] service_user.split_loggers     = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] service_user.timeout           = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance.auth_section            = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance.auth_type               = password {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance.certfile                = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance.collect_timing          = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance.insecure                = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance.keyfile                 = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance.split_loggers           = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] glance.timeout                 = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.backend_availability_zone = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.chap_password = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.chap_username =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.driver_client_cert = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.driver_client_cert_key = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.driver_data_namespace = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.driver_use_ssl = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.extra_capabilities = {} {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.filter_function = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.goodness_function = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.iscsi_target_flags =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.iscsi_write_cache = on {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.iser_helper   = tgtadm {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.iser_ip_address = 192.168.122.85 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.iser_port     = 3260 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.nas_host      =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.nas_login     = admin {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.nas_mount_options = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.nas_password  = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.nas_private_key =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.nas_share_path =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.num_shell_tries = 3 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.quobyte_volume_url = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.replication_device = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.report_discard_supported = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.reserved_percentage = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.target_helper = tgtadm {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.target_ip_address = 192.168.122.85 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.target_port   = 3260 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.target_protocol = iscsi {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.trace_flags   = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.unique_fqdn_network = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.use_chap_auth = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.volume_backend_name = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.volume_clear  = zero {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.volume_clear_ionice = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.volume_clear_size = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_reports.file_event_handler = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_reports.log_dir           = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.backend_availability_zone = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.backend_host         = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.chap_password        = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.chap_username        = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.chiscsi_conf         = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.driver_client_cert   = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.driver_data_namespace = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.driver_use_ssl       = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.extra_capabilities   = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.filter_function      = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.goodness_function    = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.iscsi_iotype         = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.iser_helper          = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.iser_ip_address      = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.iser_port            = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.iser_target_prefix   = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.nas_host             = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.nas_login            = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.nas_mount_options    = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.nas_password         = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.nas_private_key      = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.nas_share_path       = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.nas_ssh_port         = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.num_shell_tries      = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.nvmet_port_id        = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.replication_device   = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.report_discard_supported = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.reserved_percentage  = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.scst_target_driver   = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.storage_protocol     = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.target_helper        = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.target_ip_address    = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.target_port          = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.target_prefix        = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.target_protocol      = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.trace_flags          = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.use_chap_auth        = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.volume_clear         = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.volume_clear_size    = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] QuobyteHD.volumes_dir          = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.ssl      = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_notifications.driver = [] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_notifications.retry = -1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] key_manager.fixed_key          = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.barbican_api_version  = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.barbican_endpoint     = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.barbican_endpoint_type = public {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.barbican_region_name  = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.cafile                = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.certfile              = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.collect_timing        = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.insecure              = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.keyfile               = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.number_of_retries     = 60 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.retry_delay           = 1 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.send_service_user_token = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.split_loggers         = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.timeout               = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.verify_ssl            = True {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican.verify_ssl_path       = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican_service_user.auth_section = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican_service_user.auth_type = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican_service_user.cafile   = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican_service_user.certfile = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican_service_user.collect_timing = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican_service_user.insecure = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican_service_user.keyfile  = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican_service_user.split_loggers = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] barbican_service_user.timeout  = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] vault.approle_role_id          = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] vault.approle_secret_id        = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] vault.kv_mountpoint            = secret {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] vault.kv_path                  = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] vault.kv_version               = 2 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] vault.namespace                = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] vault.root_token_id            = **** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] vault.ssl_ca_crt_file          = None {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] vault.timeout                  = 60.0 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] vault.use_ssl                  = False {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 18 21:57:21 devstack cinder-volume[83137]: DEBUG oslo_service.backend._eventlet.service [None req-d4d0417f-92a4-4169-84e5-7906437cbe20 None None] ******************************************************************************** {{(pid=83137) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 18 21:57:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83342) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 18 21:57:21 devstack cinder-volume[83342]: INFO cinder.volume.drivers.quobyte [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 18 21:57:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Running cmd (subprocess): mount.quobyte {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:57:21 devstack quobyte-client[83345]: Reading configuration file: /etc/quobyte/client.cfg
Sep 18 21:57:21 devstack quobyte-client[83345]: Invalid parameters found, error: missing mount point.
Sep 18 21:57:21 devstack quobyte-client[83345]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 18 21:57:21 devstack quobyte-client[83345]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 18 21:57:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] CMD "mount.quobyte" returned: 1 in 0.286s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:57:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 21:57:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 21:57:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 21:57:21 devstack cinder-volume[83342]: INFO cinder.volume.drivers.quobyte [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Mounting volume: 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e ...
Sep 18 21:57:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 -c /etc/quobyte/client-cinder.cfg {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:57:22 devstack quobyte-client[83355]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 18 21:57:22 devstack quobyte-client[83355]: Reading configuration file: /etc/quobyte/client.cfg
Sep 18 21:57:22 devstack quobyte-client[83355]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3' to display the log.
Sep 18 21:57:22 devstack quobyte-client[83360]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 18 21:57:22 devstack quobyte-client[83360]: mount.quobyte 3.25 (4fbbd59204)
Sep 18 21:57:22 devstack quobyte-client[83360]: Client UUID: 1zGXs8eD-NCbe-YGOU-qW6t-ebyxr9WncmVK
Sep 18 21:57:22 devstack quobyte-client[83360]: Registry: osci01.corp.quobyte.com:7861
Sep 18 21:57:22 devstack quobyte-client[83360]: Volume: cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 21:57:22 devstack quobyte-client[83360]: FUSE version: 316
Sep 18 21:57:22 devstack quobyte-client[83360]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 18 21:57:22 devstack quobyte-client[83360]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 18 21:57:22 devstack quobyte-client[83360]: Setting total object cache size to 3352297472 bytes
Sep 18 21:57:22 devstack quobyte-client[83360]: Using FUSE low-level API
Sep 18 21:57:22 devstack quobyte-client[83360]: Caching of uid/gid to user/group name mappings is enabled
Sep 18 21:57:22 devstack quobyte-client[83360]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 18 21:57:22 devstack quobyte-client[83360]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 18 21:57:22 devstack quobyte-client[83360]: HTTP server started on port 55000
Sep 18 21:57:22 devstack quobyte-client[83360]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 18 21:57:22 devstack quobyte-client[83360]: Mount point /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 established
Sep 18 21:57:22 devstack quobyte-client[83360]: TimeSync is running and remote sync every 60 seconds
Sep 18 21:57:22 devstack quobyte-client[83360]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 21:57:22 devstack quobyte-client[83360]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 21:57:22 devstack quobyte-client[83360]: Opening volume cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e (6bbb64ce-4885-4d85-bbe9-caae09d0bea9)
Sep 18 21:57:22 devstack quobyte-client[83360]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 18 21:57:22 devstack quobyte-client[83360]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 21:57:22 devstack quobyte-client[83360]: Changed metadata cache configuration for volume 6bbb64ce-4885-4d85-bbe9-caae09d0bea9 to cache_ttl_ms: 0 negative_cache_ttl_ms: 0 enable_write_back_cache: false
Sep 18 21:57:22 devstack quobyte-client[83360]: Failed to invalidate inode: 38: Function not implemented
Sep 18 21:57:22 devstack quobyte-client[83360]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 21:57:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.567s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:57:22 devstack quobyte-client[83360]: Automatic minidump upload enabled by global system configuration
Sep 18 21:57:22 devstack quobyte-client[83360]: Announcing HTTP status server address 172.24.4.1
Sep 18 21:57:22 devstack quobyte-client[83360]: Registered as service (uuid 1zGXs8eD-NCbe-YGOU-qW6t-ebyxr9WncmVK)
Sep 18 21:57:22 devstack quobyte-client[83360]: Quobyte Client running as pid 83360
Sep 18 21:57:22 devstack cinder-volume[83342]: INFO cinder.volume.drivers.quobyte [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Mounting volume: 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e succeeded
Sep 18 21:57:22 devstack quobyte-client[83360]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 18 21:57:22 devstack quobyte-client[83360]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 18 21:57:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 21:57:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.635s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 21:57:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:57:22 devstack quobyte-client[83360]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 21:57:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.087s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:57:22 devstack cinder-volume[83342]: INFO cinder.volume.driver [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Driver hasn't implemented _init_vendor_properties()
Sep 18 21:57:22 devstack cinder-volume[83342]: DEBUG cinder.volume.driver [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144821166992, 'free_capacity_gb': 924.9144821166992, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83342) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 18 21:57:22 devstack cinder-volume[83342]: DEBUG oslo_db.sqlalchemy.engines [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 18 21:57:22 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writer thread running {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG cinder.db.sqlalchemy.api [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Building query based on filter {{(pid=83342) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83342) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 18 21:57:23 devstack cinder-volume[83342]: INFO cinder.keymgr.migration [None req-47271aef-ea7a-4295-afee-cb8e6020a138 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.106s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 21:57:23 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Driver initialization completed successfully.
Sep 18 21:57:23 devstack cinder-volume[83342]: INFO cinder.manager [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Initiating service 3 cleanup
Sep 18 21:57:23 devstack cinder-volume[83342]: INFO cinder.manager [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Service 3 cleanup completed.
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG cinder.service [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Creating RPC server for service cinder-volume {{(pid=83342) start /opt/stack/cinder/cinder/service.py:239}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG cinder.service [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83342) start /opt/stack/cinder/cinder/service.py:245}}
Sep 18 21:57:23 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 18 21:57:23 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 21:57:23 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:57:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.105s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:57:24 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c8175e9e-ac0e-4ebd-8522-573a54a8800e None None] Driver post RPC initialization completed successfully.
Sep 18 21:57:25 devstack quobyte-client[83360]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 18 21:57:30 devstack cinder-volume[83137]: DEBUG dbcounter [-] [83137] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83137) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 21:57:34 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 21:57:34 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 21:58:20 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 21:58:20 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 21:58:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Flow 'volume_create_manager' (9049387c-245e-4e4f-b3fe-f1c182d29d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 21:58:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030e820b-5b2e-47de-9ff3-602fbbfbeeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030e820b-5b2e-47de-9ff3-602fbbfbeeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T19:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1975957663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2edeecb-7fc0-41e6-8d65-74b4841c1246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c6119f187a4e99bd12667a582df89b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T19:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T19:58:21Z,use_quota=True,user_id='01187bddeb8c452fb25310d073b331e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795fe64a-75c1-4356-834b-d292490dcda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795fe64a-75c1-4356-834b-d292490dcda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2c28c4-945e-4909-80fd-a3926587efcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b2c28c4-945e-4909-80fd-a3926587efcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2edeecb-7fc0-41e6-8d65-74b4841c1246', 'volume_name': 'volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18c8e21-144c-45dd-91ca-244bb608c11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18c8e21-144c-45dd-91ca-244bb608c11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58eca365-ee65-40cb-9a01-f7ad5a3804fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:58:21 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Volume f2edeecb-7fc0-41e6-8d65-74b4841c1246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246', 'volume_size': 1}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T19:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1975957663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2edeecb-7fc0-41e6-8d65-74b4841c1246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38c6119f187a4e99bd12667a582df89b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T19:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T19:58:21Z,use_quota=True,user_id='01187bddeb8c452fb25310d073b331e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Creating volume f2edeecb-7fc0-41e6-8d65-74b4841c1246 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 21:58:21 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 21:58:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:58:21 devstack quobyte-client[83360]: System call of process 83628 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 21:58:21 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=2, name=volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 21:58:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246 1073741824" returned: 0 in 0.924s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:58:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:58:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246" returned: 0 in 0.167s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:58:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] <== create_volume: return (1177ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 21:58:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 21:58:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58eca365-ee65-40cb-9a01-f7ad5a3804fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:58:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee64824b-c42a-4ac8-b78c-4587b7a39672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:58:22 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Volume volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246 (f2edeecb-7fc0-41e6-8d65-74b4841c1246): created successfully
Sep 18 21:58:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee64824b-c42a-4ac8-b78c-4587b7a39672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:58:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Flow 'volume_create_manager' (9049387c-245e-4e4f-b3fe-f1c182d29d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 21:58:22 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a82198e9-517b-46e8-8804-dc0d43622df4 tempest-TaggedAttachmentsTest-2092413515 None] Created volume successfully.
Sep 18 21:58:27 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Flow 'volume_create_manager' (7118ab2d-2a75-45c8-8274-01262247f049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94395dc-1651-4838-a64d-89efad9e6f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94395dc-1651-4838-a64d-89efad9e6f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T19:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1101419887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36e8dfa-6166-499d-ba7c-870242308630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238ba3372cc741a0807d4bc3d0c6e3b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T19:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T19:58:27Z,use_quota=True,user_id='909db113b8234c5d945bf0057141abb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337cfe30-2f7c-47b8-87df-2193f871fd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337cfe30-2f7c-47b8-87df-2193f871fd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28a0d45-db12-4916-9d6c-d11f020cb121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f28a0d45-db12-4916-9d6c-d11f020cb121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a36e8dfa-6166-499d-ba7c-870242308630', 'volume_name': 'volume-a36e8dfa-6166-499d-ba7c-870242308630', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220dad85-64a0-4457-a152-7ca5f5f8f44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (220dad85-64a0-4457-a152-7ca5f5f8f44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87922c7-8ad6-442c-b651-987b7af59c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:58:27 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Volume a36e8dfa-6166-499d-ba7c-870242308630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a36e8dfa-6166-499d-ba7c-870242308630', 'volume_size': 1}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T19:58:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1101419887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36e8dfa-6166-499d-ba7c-870242308630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238ba3372cc741a0807d4bc3d0c6e3b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T19:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T19:58:27Z,use_quota=True,user_id='909db113b8234c5d945bf0057141abb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Creating volume a36e8dfa-6166-499d-ba7c-870242308630 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 21:58:27 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a36e8dfa-6166-499d-ba7c-870242308630 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:58:27 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=3, name=volume-a36e8dfa-6166-499d-ba7c-870242308630, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a36e8dfa-6166-499d-ba7c-870242308630 1073741824" returned: 0 in 0.409s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a36e8dfa-6166-499d-ba7c-870242308630 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a36e8dfa-6166-499d-ba7c-870242308630" returned: 0 in 0.105s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] <== create_volume: return (584ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 21:58:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.597s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 21:58:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87922c7-8ad6-442c-b651-987b7af59c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a36e8dfa-6166-499d-ba7c-870242308630', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:58:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dbce21-c9ad-40b6-89a6-aab3b94dd710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:58:28 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Volume volume-a36e8dfa-6166-499d-ba7c-870242308630 (a36e8dfa-6166-499d-ba7c-870242308630): created successfully
Sep 18 21:58:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dbce21-c9ad-40b6-89a6-aab3b94dd710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:58:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Flow 'volume_create_manager' (7118ab2d-2a75-45c8-8274-01262247f049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 21:58:28 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-01f9f281-6bb0-466b-8d71-19de7ff8e948 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Created volume successfully.
Sep 18 21:58:38 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=6,cinder:SELECT=3 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 21:58:38 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 21:58:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 21:58:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 21:58:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 21:58:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 21:58:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 21:58:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 21:58:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:58:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.108s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:58:46 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 21:59:27 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 21:59:27 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 21:59:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Flow 'volume_create_manager' (dc366040-978d-4aa9-8ba7-99edaf5022c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 21:59:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae909173-e1a3-4a29-97ab-bc20f5830f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:59:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae909173-e1a3-4a29-97ab-bc20f5830f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T19:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-495748682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d5e37e-f2af-4c07-839e-303a8c2c4422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b83e5d9f434c69acf84c54b4b2d63d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T19:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T19:59:27Z,use_quota=True,user_id='a8ade407b66c42c7a7c960ebf13995b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:59:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52bde44d-2029-43b8-88cb-a1ae05d9ae01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:59:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52bde44d-2029-43b8-88cb-a1ae05d9ae01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38710ef-2823-4464-b495-f9fc32b0f835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38710ef-2823-4464-b495-f9fc32b0f835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d5e37e-f2af-4c07-839e-303a8c2c4422', 'volume_name': 'volume-90d5e37e-f2af-4c07-839e-303a8c2c4422', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2190bce-cf6b-4995-a5a4-ddb02b4c35a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2190bce-cf6b-4995-a5a4-ddb02b4c35a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08816f42-d848-4048-bdd3-b680eba9d4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:59:28 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Volume 90d5e37e-f2af-4c07-839e-303a8c2c4422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d5e37e-f2af-4c07-839e-303a8c2c4422', 'volume_size': 1}
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T19:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-495748682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d5e37e-f2af-4c07-839e-303a8c2c4422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0b83e5d9f434c69acf84c54b4b2d63d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T19:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T19:59:27Z,use_quota=True,user_id='a8ade407b66c42c7a7c960ebf13995b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Creating volume 90d5e37e-f2af-4c07-839e-303a8c2c4422 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 21:59:28 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 21:59:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-90d5e37e-f2af-4c07-839e-303a8c2c4422 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:59:28 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=4, name=volume-90d5e37e-f2af-4c07-839e-303a8c2c4422, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 21:59:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-90d5e37e-f2af-4c07-839e-303a8c2c4422 1073741824" returned: 0 in 1.379s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:59:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-90d5e37e-f2af-4c07-839e-303a8c2c4422 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:59:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-90d5e37e-f2af-4c07-839e-303a8c2c4422" returned: 0 in 0.354s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:59:30 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] <== create_volume: return (1954ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 21:59:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 21:59:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08816f42-d848-4048-bdd3-b680eba9d4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d5e37e-f2af-4c07-839e-303a8c2c4422', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:59:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a11770-3776-4c73-b615-9661dac7a0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 21:59:30 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Volume volume-90d5e37e-f2af-4c07-839e-303a8c2c4422 (90d5e37e-f2af-4c07-839e-303a8c2c4422): created successfully
Sep 18 21:59:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a11770-3776-4c73-b615-9661dac7a0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 21:59:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Flow 'volume_create_manager' (dc366040-978d-4aa9-8ba7-99edaf5022c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 21:59:31 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-fb75773f-038d-4469-a336-1d70ffad4068 tempest-VolumesAdminNegativeTest-560705360 None] Created volume successfully.
Sep 18 21:59:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Acquiring lock "cinder-90d5e37e-f2af-4c07-839e-303a8c2c4422-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 21:59:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Lock "cinder-90d5e37e-f2af-4c07-839e-303a8c2c4422-delete_volume" acquired by "delete_volume" :: waited 0.235s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 21:59:34 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 21:59:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Acquiring lock "cinder-quobyte-90d5e37e-f2af-4c07-839e-303a8c2c4422" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 21:59:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Lock "cinder-quobyte-90d5e37e-f2af-4c07-839e-303a8c2c4422" acquired by "delete_volume" :: waited 0.060s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 21:59:34 devstack cinder-volume[83342]: INFO oslo.privsep.daemon [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpop_wqj8p/privsep.sock']
Sep 18 21:59:35 devstack sudo[84340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpop_wqj8p/privsep.sock
Sep 18 21:59:35 devstack sudo[84340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 21:59:44 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1,cinder:SELECT=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 21:59:44 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 21:59:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 21:59:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 21:59:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 21:59:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 21:59:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 21:59:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 21:59:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:59:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.376s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:59:46 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 21:59:55 devstack sudo[84340]: pam_unix(sudo:session): session closed for user root
Sep 18 21:59:56 devstack cinder-volume[83342]: INFO oslo.privsep.daemon [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Spawned new privsep daemon via rootwrap
Sep 18 21:59:56 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Accepted privsep connection to /tmp/tmpop_wqj8p/privsep.sock {{(pid=83342) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 18 21:59:56 devstack cinder-volume[83342]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 18 21:59:56 devstack cinder-volume[83342]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 18 21:59:56 devstack cinder-volume[83342]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 18 21:59:56 devstack cinder-volume[83342]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84431
Sep 18 21:59:56 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[184e2640-f8f7-47af-a498-a39e146fe13d]: (2,) {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 21:59:56 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40abc41-4a24-4940-bf07-324c29b7e61c]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 21:59:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-90d5e37e-f2af-4c07-839e-303a8c2c4422 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:59:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-90d5e37e-f2af-4c07-839e-303a8c2c4422" returned: 0 in 1.674s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:59:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-90d5e37e-f2af-4c07-839e-303a8c2c4422 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:59:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-90d5e37e-f2af-4c07-839e-303a8c2c4422" returned: 0 in 0.174s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:59:58 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Lock "cinder-quobyte-90d5e37e-f2af-4c07-839e-303a8c2c4422" released by "delete_volume" :: held 23.599s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 21:59:59 devstack cinder-volume[83342]: WARNING cinder.quota [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 18 21:59:59 devstack cinder-volume[83342]: WARNING cinder.quota [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 18 21:59:59 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Created reservations ['6be33a0b-2d66-431c-a3d4-6a92c76b1fc4', 'fb360d35-ac25-434b-a37b-b176b5db827f', '23ba2364-7f84-44bb-a995-6b1890ce2de5', '6cf77ab0-32d0-4a3e-8a46-0644f1b65699'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 21:59:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 21:59:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 21:59:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 21:59:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 21:59:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 21:59:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 21:59:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.134s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 21:59:59 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 21:59:59 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Deleted volume successfully.
Sep 18 22:00:00 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fc54bcfe-0619-4342-85b9-80060274bc08 tempest-VolumesAdminNegativeTest-560705360 None] Lock "cinder-90d5e37e-f2af-4c07-839e-303a8c2c4422-delete_volume" released by "delete_volume" :: held 26.055s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:00:09 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:00:10 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:00:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:00:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:00:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:00:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:00:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:00:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:00:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:00:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.320s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:00:46 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:01:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-a18068f7-cff2-46e5-b75f-ce996276783a req-81b1ae10-79af-483d-8e75-f0d5122c439c tempest-TaggedAttachmentsTest-2092413515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:01:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-a18068f7-cff2-46e5-b75f-ce996276783a req-81b1ae10-79af-483d-8e75-f0d5122c439c tempest-TaggedAttachmentsTest-2092413515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:01:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-91ddc079-4a9e-48d9-8b7b-7e2f53a09941 req-ec89e6c0-9f00-4303-9588-698c180a4eb6 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:01:06 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b0fa0d-2bd4-4a9d-b05e-9f142b87c88c]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:01:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-a18068f7-cff2-46e5-b75f-ce996276783a req-81b1ae10-79af-483d-8e75-f0d5122c439c tempest-TaggedAttachmentsTest-2092413515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:01:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-a18068f7-cff2-46e5-b75f-ce996276783a req-81b1ae10-79af-483d-8e75-f0d5122c439c tempest-TaggedAttachmentsTest-2092413515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246" returned: 0 in 0.413s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:01:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-a18068f7-cff2-46e5-b75f-ce996276783a req-81b1ae10-79af-483d-8e75-f0d5122c439c tempest-TaggedAttachmentsTest-2092413515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.475s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:01:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-91ddc079-4a9e-48d9-8b7b-7e2f53a09941 req-ec89e6c0-9f00-4303-9588-698c180a4eb6 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.522s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:01:07 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf2f8a6-90b0-4bdf-894e-bc2f0fe47bd8]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:01:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-91ddc079-4a9e-48d9-8b7b-7e2f53a09941 req-ec89e6c0-9f00-4303-9588-698c180a4eb6 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a36e8dfa-6166-499d-ba7c-870242308630 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:01:07 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-a18068f7-cff2-46e5-b75f-ce996276783a req-81b1ae10-79af-483d-8e75-f0d5122c439c tempest-TaggedAttachmentsTest-2092413515 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '472c1630-e6ee-4396-ba3f-df69b076f83b', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:01:07 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-a18068f7-cff2-46e5-b75f-ce996276783a req-81b1ae10-79af-483d-8e75-f0d5122c439c tempest-TaggedAttachmentsTest-2092413515 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:01:07 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-a18068f7-cff2-46e5-b75f-ce996276783a req-81b1ae10-79af-483d-8e75-f0d5122c439c tempest-TaggedAttachmentsTest-2092413515 None] attachment_update completed successfully.
Sep 18 22:01:07 devstack quobyte-client[83360]: System call of process 84791 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:01:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-91ddc079-4a9e-48d9-8b7b-7e2f53a09941 req-ec89e6c0-9f00-4303-9588-698c180a4eb6 tempest-VolumesAssistedSnapshotsTest-1342169962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a36e8dfa-6166-499d-ba7c-870242308630" returned: 0 in 0.623s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:01:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-91ddc079-4a9e-48d9-8b7b-7e2f53a09941 req-ec89e6c0-9f00-4303-9588-698c180a4eb6 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.862s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:01:07 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-91ddc079-4a9e-48d9-8b7b-7e2f53a09941 req-ec89e6c0-9f00-4303-9588-698c180a4eb6 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-a36e8dfa-6166-499d-ba7c-870242308630', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3315b09b-87c1-448a-908d-2d5ad5956e7b', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:01:07 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-91ddc079-4a9e-48d9-8b7b-7e2f53a09941 req-ec89e6c0-9f00-4303-9588-698c180a4eb6 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:01:08 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-91ddc079-4a9e-48d9-8b7b-7e2f53a09941 req-ec89e6c0-9f00-4303-9588-698c180a4eb6 tempest-VolumesAssistedSnapshotsTest-1342169962 None] attachment_update completed successfully.
Sep 18 22:01:18 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:01:18 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:01:22 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Flow 'volume_create_manager' (667de115-27f4-42ca-bafc-d7be7c58c536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c6b66b-b968-4912-940e-b57f504da82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c6b66b-b968-4912-940e-b57f504da82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1007926852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acb568e-e3f5-4392-955d-4c12ca7bef27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8053449d49eb4f54998cdab2340e65ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:01:22Z,use_quota=True,user_id='d1e34522b3ee47acb63c667918965c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a513a6cd-b4a4-4d35-aef4-ca4b8ec8e7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a513a6cd-b4a4-4d35-aef4-ca4b8ec8e7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab37e29-5d00-4323-bee9-c2b259a4f10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab37e29-5d00-4323-bee9-c2b259a4f10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6acb568e-e3f5-4392-955d-4c12ca7bef27', 'volume_name': 'volume-6acb568e-e3f5-4392-955d-4c12ca7bef27', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4a5bd9-f06f-4213-afc8-5cb086952aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c4a5bd9-f06f-4213-afc8-5cb086952aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5e7e38-f8d1-43da-bbff-ff5dfd512398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:01:22 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Volume 6acb568e-e3f5-4392-955d-4c12ca7bef27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6acb568e-e3f5-4392-955d-4c12ca7bef27', 'volume_size': 1}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1007926852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acb568e-e3f5-4392-955d-4c12ca7bef27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8053449d49eb4f54998cdab2340e65ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:01:22Z,use_quota=True,user_id='d1e34522b3ee47acb63c667918965c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Creating volume 6acb568e-e3f5-4392-955d-4c12ca7bef27 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:01:22 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6acb568e-e3f5-4392-955d-4c12ca7bef27 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:01:22 devstack quobyte-client[83360]: System call of process 85290 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:01:22 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=5, name=volume-6acb568e-e3f5-4392-955d-4c12ca7bef27, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6acb568e-e3f5-4392-955d-4c12ca7bef27 1073741824" returned: 0 in 0.419s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6acb568e-e3f5-4392-955d-4c12ca7bef27 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6acb568e-e3f5-4392-955d-4c12ca7bef27" returned: 0 in 0.090s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] <== create_volume: return (572ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:01:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.584s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:01:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5e7e38-f8d1-43da-bbff-ff5dfd512398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6acb568e-e3f5-4392-955d-4c12ca7bef27', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:01:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad83f67d-6779-493d-831d-62cba95defd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:01:23 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Volume volume-6acb568e-e3f5-4392-955d-4c12ca7bef27 (6acb568e-e3f5-4392-955d-4c12ca7bef27): created successfully
Sep 18 22:01:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad83f67d-6779-493d-831d-62cba95defd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:01:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Flow 'volume_create_manager' (667de115-27f4-42ca-bafc-d7be7c58c536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:01:23 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-04b5b72c-b00e-424b-8c4b-d5c8edef9e5e tempest-DeleteServersTestJSON-491448701 None] Created volume successfully.
Sep 18 22:01:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-a8c6f80e-efc3-4dd3-839a-d8f30181151f req-eec21cb1-0639-41ac-8220-c461ad06a050 tempest-DeleteServersTestJSON-491448701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:01:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-a8c6f80e-efc3-4dd3-839a-d8f30181151f req-eec21cb1-0639-41ac-8220-c461ad06a050 tempest-DeleteServersTestJSON-491448701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:01:28 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[94070ac7-7839-414e-a90b-3d15f738077f]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:01:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-a8c6f80e-efc3-4dd3-839a-d8f30181151f req-eec21cb1-0639-41ac-8220-c461ad06a050 tempest-DeleteServersTestJSON-491448701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6acb568e-e3f5-4392-955d-4c12ca7bef27 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:01:29 devstack quobyte-client[83360]: System call of process 85309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:01:29 devstack quobyte-client[83360]: System call of process 85309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:01:29 devstack quobyte-client[83360]: System call of process 85309 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:01:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-a8c6f80e-efc3-4dd3-839a-d8f30181151f req-eec21cb1-0639-41ac-8220-c461ad06a050 tempest-DeleteServersTestJSON-491448701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6acb568e-e3f5-4392-955d-4c12ca7bef27" returned: 0 in 0.712s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:01:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-a8c6f80e-efc3-4dd3-839a-d8f30181151f req-eec21cb1-0639-41ac-8220-c461ad06a050 tempest-DeleteServersTestJSON-491448701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.792s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:01:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-a8c6f80e-efc3-4dd3-839a-d8f30181151f req-eec21cb1-0639-41ac-8220-c461ad06a050 tempest-DeleteServersTestJSON-491448701 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-6acb568e-e3f5-4392-955d-4c12ca7bef27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '076d8b13-1ea2-49d7-9ba2-6baf29f0ff50', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:01:29 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-a8c6f80e-efc3-4dd3-839a-d8f30181151f req-eec21cb1-0639-41ac-8220-c461ad06a050 tempest-DeleteServersTestJSON-491448701 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:01:29 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-a8c6f80e-efc3-4dd3-839a-d8f30181151f req-eec21cb1-0639-41ac-8220-c461ad06a050 tempest-DeleteServersTestJSON-491448701 None] attachment_update completed successfully.
Sep 18 22:01:39 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:01:39 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:01:40 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-2abdcebf-2042-499c-933a-30677d9898ab req-c93e1456-5290-485e-9f02-cf90db20f76f tempest-VolumesAssistedSnapshotsTest-1342169962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:01:40 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-2abdcebf-2042-499c-933a-30677d9898ab req-c93e1456-5290-485e-9f02-cf90db20f76f tempest-VolumesAssistedSnapshotsTest-1342169962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:01:40 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-2abdcebf-2042-499c-933a-30677d9898ab req-c93e1456-5290-485e-9f02-cf90db20f76f tempest-VolumesAssistedSnapshotsTest-1342169962 None] Terminate volume connection completed successfully.
Sep 18 22:01:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-2abdcebf-2042-499c-933a-30677d9898ab req-c93e1456-5290-485e-9f02-cf90db20f76f tempest-VolumesAssistedSnapshotsTest-1342169962 None] Deleting attachment 3315b09b-87c1-448a-908d-2d5ad5956e7b. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:01:41 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-855b5d19-06f4-4ed9-93f5-793c2247cf3a req-1f6e13df-9c18-4049-b417-f2f5a30d8a15 tempest-TaggedAttachmentsTest-2092413515 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:01:41 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-855b5d19-06f4-4ed9-93f5-793c2247cf3a req-1f6e13df-9c18-4049-b417-f2f5a30d8a15 tempest-TaggedAttachmentsTest-2092413515 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:01:41 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-855b5d19-06f4-4ed9-93f5-793c2247cf3a req-1f6e13df-9c18-4049-b417-f2f5a30d8a15 tempest-TaggedAttachmentsTest-2092413515 None] Terminate volume connection completed successfully.
Sep 18 22:01:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-855b5d19-06f4-4ed9-93f5-793c2247cf3a req-1f6e13df-9c18-4049-b417-f2f5a30d8a15 tempest-TaggedAttachmentsTest-2092413515 None] Deleting attachment 472c1630-e6ee-4396-ba3f-df69b076f83b. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:01:41 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Acquiring lock "cinder-a36e8dfa-6166-499d-ba7c-870242308630-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:01:41 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Lock "cinder-a36e8dfa-6166-499d-ba7c-870242308630-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:01:41 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:01:41 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Acquiring lock "cinder-quobyte-a36e8dfa-6166-499d-ba7c-870242308630" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:01:41 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Lock "cinder-quobyte-a36e8dfa-6166-499d-ba7c-870242308630" acquired by "delete_volume" :: waited 0.022s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:01:41 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b95e85e-6a34-4e27-90b8-826222b6779e]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:01:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a36e8dfa-6166-499d-ba7c-870242308630 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:01:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a36e8dfa-6166-499d-ba7c-870242308630" returned: 0 in 0.493s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:01:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a36e8dfa-6166-499d-ba7c-870242308630 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:01:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a36e8dfa-6166-499d-ba7c-870242308630" returned: 0 in 0.092s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:01:42 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Lock "cinder-quobyte-a36e8dfa-6166-499d-ba7c-870242308630" released by "delete_volume" :: held 0.782s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:01:42 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-d5c599dc-68fc-46ca-a9d8-bb1de9827a08 req-fb85e66a-c18d-4b88-ac86-94109f619f69 tempest-DeleteServersTestJSON-491448701 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:01:42 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-d5c599dc-68fc-46ca-a9d8-bb1de9827a08 req-fb85e66a-c18d-4b88-ac86-94109f619f69 tempest-DeleteServersTestJSON-491448701 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:01:42 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-d5c599dc-68fc-46ca-a9d8-bb1de9827a08 req-fb85e66a-c18d-4b88-ac86-94109f619f69 tempest-DeleteServersTestJSON-491448701 None] Terminate volume connection completed successfully.
Sep 18 22:01:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-d5c599dc-68fc-46ca-a9d8-bb1de9827a08 req-fb85e66a-c18d-4b88-ac86-94109f619f69 tempest-DeleteServersTestJSON-491448701 None] Deleting attachment 076d8b13-1ea2-49d7-9ba2-6baf29f0ff50. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:01:42 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Created reservations ['ed65161f-2422-42f8-96fd-5b5ab960a9a5', '847f1c7b-df4b-44ce-9661-8bfbe6634880', 'a249f387-f26d-4478-bf0a-cfec761c3370', '43ba0d14-7996-4b6e-9e08-035b96ee2f9e'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:01:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:01:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:01:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:01:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:01:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:01:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:01:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.126s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:01:43 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:01:43 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Deleted volume successfully.
Sep 18 22:01:43 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1fe81e9f-032f-469a-8186-41e6879ec8b8 tempest-VolumesAssistedSnapshotsTest-1342169962 None] Lock "cinder-a36e8dfa-6166-499d-ba7c-870242308630-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:01:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:01:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:01:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:01:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:01:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:01:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.093s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:01:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:01:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.241s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:01:46 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:01:47 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Acquiring lock "cinder-6acb568e-e3f5-4392-955d-4c12ca7bef27-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:01:47 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Lock "cinder-6acb568e-e3f5-4392-955d-4c12ca7bef27-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:01:48 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:01:48 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Acquiring lock "cinder-quobyte-6acb568e-e3f5-4392-955d-4c12ca7bef27" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:01:48 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Lock "cinder-quobyte-6acb568e-e3f5-4392-955d-4c12ca7bef27" acquired by "delete_volume" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:01:48 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff5e9bf-5bb7-45cb-a9c4-01c872a9d081]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:01:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6acb568e-e3f5-4392-955d-4c12ca7bef27 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:01:48 devstack quobyte-client[83360]: System call of process 85520 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:01:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6acb568e-e3f5-4392-955d-4c12ca7bef27" returned: 0 in 0.445s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:01:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6acb568e-e3f5-4392-955d-4c12ca7bef27 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:01:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6acb568e-e3f5-4392-955d-4c12ca7bef27" returned: 0 in 0.231s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:01:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Lock "cinder-quobyte-6acb568e-e3f5-4392-955d-4c12ca7bef27" released by "delete_volume" :: held 0.944s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:01:49 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Created reservations ['6ed8ac68-3e6d-4878-95c6-28f5e1209eee', 'd039a2ce-c8b5-4cf3-9aea-bd056261f6dc', '620557ca-7843-4e28-b51e-b4337faf8bb4', '8e8d9fb9-f7bd-4c81-974b-85ab90099aed'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:01:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:01:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:01:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:01:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:01:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:01:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:01:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.131s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:01:49 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:01:49 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Deleted volume successfully.
Sep 18 22:01:50 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9571b2c1-c5bf-4020-b271-35e76f24248f tempest-DeleteServersTestJSON-491448701 None] Lock "cinder-6acb568e-e3f5-4392-955d-4c12ca7bef27-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:01:59 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=13,cinder:UPDATE=10 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:02:00 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=13,cinder:UPDATE=22,cinder:INSERT=8,cinder:DELETE=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:02:27 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:02:27 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:02:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Flow 'volume_create_manager' (604a9e5d-34e8-4608-b67f-d7bcb1bca53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:02:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf8a3dc-eb58-4511-b612-5f3b96dfce2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf8a3dc-eb58-4511-b612-5f3b96dfce2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1514516198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b2495d-6900-4b01-bb6d-32d440ddf2af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e04111ec554f168f7f47690ef1b2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:02:27Z,use_quota=True,user_id='711915edbaea46c1830c55b2e63bfdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d93a4b4-8ca4-4f92-a4d7-e0b12e6cc1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d93a4b4-8ca4-4f92-a4d7-e0b12e6cc1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576d348b-1d04-4f8d-9171-7279d2465d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:28 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Acquiring lock "cinder-f2edeecb-7fc0-41e6-8d65-74b4841c1246-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:02:28 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Lock "cinder-f2edeecb-7fc0-41e6-8d65-74b4841c1246-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:02:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576d348b-1d04-4f8d-9171-7279d2465d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07b2495d-6900-4b01-bb6d-32d440ddf2af', 'volume_name': 'volume-07b2495d-6900-4b01-bb6d-32d440ddf2af', 'volume_size': 1, 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b51f48f363a84a708334255554fa3921', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'created_at': datetime.datetime(2025, 9, 18, 19, 51, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 19, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e9f9b45e-88d0-41ad-b728-fb173316839e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f905e89a890>}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0230c6a5-fd86-4759-add7-1675df3aa7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0230c6a5-fd86-4759-add7-1675df3aa7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcea2bf2-06cb-4755-a885-4536ac36b8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:28 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Volume 07b2495d-6900-4b01-bb6d-32d440ddf2af: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07b2495d-6900-4b01-bb6d-32d440ddf2af', 'volume_size': 1, 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b51f48f363a84a708334255554fa3921', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'created_at': datetime.datetime(2025, 9, 18, 19, 51, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 19, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e9f9b45e-88d0-41ad-b728-fb173316839e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f905e89a890>}
Sep 18 22:02:28 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Cloning 07b2495d-6900-4b01-bb6d-32d440ddf2af from image e9f9b45e-88d0-41ad-b728-fb173316839e  at location (None, None). {{(pid=83342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 18 22:02:28 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:02:28 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Acquiring lock "cinder-quobyte-f2edeecb-7fc0-41e6-8d65-74b4841c1246" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:02:28 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Lock "cinder-quobyte-f2edeecb-7fc0-41e6-8d65-74b4841c1246" acquired by "delete_volume" :: waited 0.020s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:02:28 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f79de33-a931-4c97-89f9-ef406f519587]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:02:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:29 devstack quobyte-client[83360]: System call of process 85596 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:02:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246" returned: 0 in 0.582s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f2edeecb-7fc0-41e6-8d65-74b4841c1246" returned: 0 in 0.119s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:29 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_np50ts15devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 22:02:29 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Image download 20.69 MB at 20.69 MB/s
Sep 18 22:02:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Lock "cinder-quobyte-f2edeecb-7fc0-41e6-8d65-74b4841c1246" released by "delete_volume" :: held 0.949s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:02:29 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae83e31-6e7f-4b69-a546-c6050835c6d8]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:02:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_np50ts15devstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:29 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Created reservations ['6685b479-2508-4ac8-9dd5-f0546c5f7338', '9d972078-771f-44ac-8e6d-262c515a5e00', 'a5c00bf3-5d4a-4e0b-801b-13a6ed6d1d30', 'd6dcb3df-2b86-4674-b240-5c6053808f44'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:02:30 devstack sudo[85620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_np50ts15devstack@QuobyteHD
Sep 18 22:02:30 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:02:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:02:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:02:30 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:02:30 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:02:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:02:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.150s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:30 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:02:30 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Deleted volume successfully.
Sep 18 22:02:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-176e3f72-b172-43da-b392-810e920ff501 tempest-TaggedAttachmentsTest-2092413515 None] Lock "cinder-f2edeecb-7fc0-41e6-8d65-74b4841c1246-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:02:32 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root
Sep 18 22:02:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_np50ts15devstack@QuobyteHD" returned: 0 in 2.916s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:32 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Temporary image e9f9b45e-88d0-41ad-b728-fb173316839e is fetched for user 711915edbaea46c1830c55b2e63bfdcc. {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 22:02:32 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c0ca90-ad72-497e-8ecd-e794cddf4882]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:02:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_np50ts15devstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:33 devstack sudo[85627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_np50ts15devstack@QuobyteHD
Sep 18 22:02:33 devstack sudo[85627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:02:36 devstack sudo[85627]: pam_unix(sudo:session): session closed for user root
Sep 18 22:02:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_np50ts15devstack@QuobyteHD" returned: 0 in 3.960s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:02:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:02:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1514516198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07b2495d-6900-4b01-bb6d-32d440ddf2af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e04111ec554f168f7f47690ef1b2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:02:27Z,use_quota=True,user_id='711915edbaea46c1830c55b2e63bfdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:02:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Creating volume 07b2495d-6900-4b01-bb6d-32d440ddf2af {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:02:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:02:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:02:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:02:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:02:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:02:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:02:36 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:02:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:37 devstack quobyte-client[83360]: System call of process 85634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:02:37 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=6, name=volume-07b2495d-6900-4b01-bb6d-32d440ddf2af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:02:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af 1073741824" returned: 0 in 0.523s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af" returned: 0 in 0.222s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] <== create_volume: return (967ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:02:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:02:38 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Attempting download of e9f9b45e-88d0-41ad-b728-fb173316839e ((None, None)) to volume 07b2495d-6900-4b01-bb6d-32d440ddf2af. {{(pid=83342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 22:02:38 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0598d4c8-99e4-4e60-98ec-585bc659e2bb]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:02:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_siagcjcw {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_siagcjcw" returned: 0 in 0.470s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_siagcjcw {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_siagcjcw" returned: 1 in 0.514s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_siagcjcw' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:02:39 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f651b1-a330-4823-ae54-d97d591f82b4]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:02:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_np50ts15devstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_np50ts15devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:39 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] e9f9b45e-88d0-41ad-b728-fb173316839e was qcow2, converting to raw {{(pid=83342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 22:02:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_np50ts15devstack@QuobyteHD /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:40 devstack quobyte-client[83360]: System call of process 85646 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:02:40 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=6, name=volume-07b2495d-6900-4b01-bb6d-32d440ddf2af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:02:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_np50ts15devstack@QuobyteHD /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af" returned: 0 in 1.309s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:41 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_np50ts15devstack@QuobyteHD, size 112.00 MB, duration 1.34 sec, destination /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af {{(pid=83342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 22:02:41 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Converted 112.00 MB image at 83.68 MB/s
Sep 18 22:02:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:41 devstack quobyte-client[83360]: System call of process 85652 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:02:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af 1G" returned: 0 in 0.263s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:41 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5cabe7-bb72-4868-97a9-b10f2a59f879]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:02:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:42 devstack quobyte-client[83360]: System call of process 85685 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:02:42 devstack quobyte-client[83360]: System call of process 85685 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:02:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af" returned: 0 in 0.725s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:42 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=12,cinder:SELECT=6,cinder:INSERT=3 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:02:43 devstack quobyte-client[83360]: System call of process 85689 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:02:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af" returned: 1 in 0.516s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:02:43 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Downloaded image e9f9b45e-88d0-41ad-b728-fb173316839e ((None, None)) to volume 07b2495d-6900-4b01-bb6d-32d440ddf2af successfully. {{(pid=83342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 22:02:43 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Temporary image e9f9b45e-88d0-41ad-b728-fb173316839e for user 711915edbaea46c1830c55b2e63bfdcc is deleted. {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 22:02:43 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Marking volume 07b2495d-6900-4b01-bb6d-32d440ddf2af as bootable. {{(pid=83342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 22:02:43 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Copying metadata from image e9f9b45e-88d0-41ad-b728-fb173316839e to 07b2495d-6900-4b01-bb6d-32d440ddf2af. {{(pid=83342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 22:02:43 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Creating volume glance metadata for volume 07b2495d-6900-4b01-bb6d-32d440ddf2af backed by image e9f9b45e-88d0-41ad-b728-fb173316839e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 22:02:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcea2bf2-06cb-4755-a885-4536ac36b8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07b2495d-6900-4b01-bb6d-32d440ddf2af', 'volume_size': 1, 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b51f48f363a84a708334255554fa3921', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'created_at': datetime.datetime(2025, 9, 18, 19, 51, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 19, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e9f9b45e-88d0-41ad-b728-fb173316839e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f905e89a890>}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e11292-1d7b-4c05-a052-57616828c107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:43 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Volume volume-07b2495d-6900-4b01-bb6d-32d440ddf2af (07b2495d-6900-4b01-bb6d-32d440ddf2af): created successfully
Sep 18 22:02:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e11292-1d7b-4c05-a052-57616828c107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Flow 'volume_create_manager' (604a9e5d-34e8-4608-b67f-d7bcb1bca53e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:02:43 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-64bfa65c-795d-41e3-9a83-ec6875c4a978 tempest-TaggedBootDevicesTest-1655784659 None] Created volume successfully.
Sep 18 22:02:45 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Flow 'volume_create_manager' (80911e7b-7c30-4006-86cc-4da5d2fc4626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa600d25-d9c9-4999-b291-1f2c208409bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa600d25-d9c9-4999-b291-1f2c208409bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2144647657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b30f51d0-45a7-4340-ba4c-d69f36180b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e04111ec554f168f7f47690ef1b2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:02:45Z,use_quota=True,user_id='711915edbaea46c1830c55b2e63bfdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542f4849-a7bc-4f61-bad7-d240b8364b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542f4849-a7bc-4f61-bad7-d240b8364b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f257504-6862-4002-a117-b798f083a7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f257504-6862-4002-a117-b798f083a7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b30f51d0-45a7-4340-ba4c-d69f36180b33', 'volume_name': 'volume-b30f51d0-45a7-4340-ba4c-d69f36180b33', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff03c88-521f-45be-a99f-1447bee077d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ff03c88-521f-45be-a99f-1447bee077d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba5ec2c-775d-4db9-a918-d1e72deb9095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:45 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Volume b30f51d0-45a7-4340-ba4c-d69f36180b33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b30f51d0-45a7-4340-ba4c-d69f36180b33', 'volume_size': 1}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-2144647657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b30f51d0-45a7-4340-ba4c-d69f36180b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e04111ec554f168f7f47690ef1b2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:02:45Z,use_quota=True,user_id='711915edbaea46c1830c55b2e63bfdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Creating volume b30f51d0-45a7-4340-ba4c-d69f36180b33 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:02:45 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:02:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b30f51d0-45a7-4340-ba4c-d69f36180b33 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:45 devstack quobyte-client[83360]: System call of process 85693 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:02:45 devstack quobyte-client[83360]: System call of process 85693 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:02:45 devstack quobyte-client[83360]: System call of process 85693 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:02:45 devstack quobyte-client[83360]: System call of process 85693 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:02:45 devstack quobyte-client[83360]: System call of process 85693 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:02:45 devstack quobyte-client[83360]: System call of process 85693 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:02:45 devstack quobyte-client[83360]: System call of process 85693 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:02:45 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=7, name=volume-b30f51d0-45a7-4340-ba4c-d69f36180b33, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b30f51d0-45a7-4340-ba4c-d69f36180b33 1073741824" returned: 0 in 0.395s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b30f51d0-45a7-4340-ba4c-d69f36180b33 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b30f51d0-45a7-4340-ba4c-d69f36180b33" returned: 0 in 0.301s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] <== create_volume: return (863ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba5ec2c-775d-4db9-a918-d1e72deb9095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b30f51d0-45a7-4340-ba4c-d69f36180b33', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1892e9-23c8-4580-9fdb-dfdde7794994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.570s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:02:46 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Volume volume-b30f51d0-45a7-4340-ba4c-d69f36180b33 (b30f51d0-45a7-4340-ba4c-d69f36180b33): created successfully
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1892e9-23c8-4580-9fdb-dfdde7794994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Flow 'volume_create_manager' (80911e7b-7c30-4006-86cc-4da5d2fc4626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:02:47 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-5c2b31b7-57f8-45e7-97a4-a45a216db280 tempest-TaggedBootDevicesTest-1655784659 None] Created volume successfully.
Sep 18 22:02:47 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:02:47 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Flow 'volume_create_manager' (a4583604-f4b5-4990-b215-99c8a6443e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920473dc-79d9-4132-a635-2d6c7fcf97e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920473dc-79d9-4132-a635-2d6c7fcf97e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-420091696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e04111ec554f168f7f47690ef1b2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:02:48Z,use_quota=True,user_id='711915edbaea46c1830c55b2e63bfdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab317c8-1979-4fc0-96e8-dfe610cce707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab317c8-1979-4fc0-96e8-dfe610cce707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4f3794-c276-4400-a56b-76d9dacab240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b4f3794-c276-4400-a56b-76d9dacab240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9', 'volume_name': 'volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163642c2-eab8-4100-89b7-9cbe59dc3261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163642c2-eab8-4100-89b7-9cbe59dc3261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611bb239-732b-4595-b964-6565c4839e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:48 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Volume e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9', 'volume_size': 1}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-420091696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15e04111ec554f168f7f47690ef1b2ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:02:48Z,use_quota=True,user_id='711915edbaea46c1830c55b2e63bfdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Creating volume e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:02:48 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:48 devstack quobyte-client[83360]: System call of process 85699 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:02:48 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=8, name=volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9 1073741824" returned: 0 in 0.411s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9" returned: 0 in 0.177s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] <== create_volume: return (668ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:02:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:02:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611bb239-732b-4595-b964-6565c4839e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a647c4-5e53-4564-a625-5b3f7329a419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:02:49 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Volume volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9 (e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9): created successfully
Sep 18 22:02:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a647c4-5e53-4564-a625-5b3f7329a419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:02:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Flow 'volume_create_manager' (a4583604-f4b5-4990-b215-99c8a6443e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:02:49 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-44e79b71-663c-403b-a8d6-fee25bbc2109 tempest-TaggedBootDevicesTest-1655784659 None] Created volume successfully.
Sep 18 22:02:59 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=6,cinder:SELECT=16,cinder:INSERT=12,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:02:59 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=9,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=3 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:03:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-3d3186de-7b3a-49c3-ac3c-73396d0cb730 tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:03:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-3d3186de-7b3a-49c3-ac3c-73396d0cb730 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:03:24 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8e6cee-14a7-403b-818a-4d07c3eb1f05]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:03:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-3d3186de-7b3a-49c3-ac3c-73396d0cb730 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:03:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-3d3186de-7b3a-49c3-ac3c-73396d0cb730 tempest-TaggedBootDevicesTest-1655784659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af" returned: 0 in 0.651s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:03:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-3d3186de-7b3a-49c3-ac3c-73396d0cb730 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:03:26 devstack quobyte-client[83360]: System call of process 85766 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:03:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-3d3186de-7b3a-49c3-ac3c-73396d0cb730 tempest-TaggedBootDevicesTest-1655784659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af" returned: 1 in 1.113s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:03:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-3d3186de-7b3a-49c3-ac3c-73396d0cb730 tempest-TaggedBootDevicesTest-1655784659 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:03:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-3d3186de-7b3a-49c3-ac3c-73396d0cb730 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.168s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:03:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-3d3186de-7b3a-49c3-ac3c-73396d0cb730 tempest-TaggedBootDevicesTest-1655784659 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-07b2495d-6900-4b01-bb6d-32d440ddf2af', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '570be27d-b4e6-450b-bddd-2891f7133a29', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:03:27 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-3d3186de-7b3a-49c3-ac3c-73396d0cb730 tempest-TaggedBootDevicesTest-1655784659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:03:27 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-3d3186de-7b3a-49c3-ac3c-73396d0cb730 tempest-TaggedBootDevicesTest-1655784659 None] attachment_update completed successfully.
Sep 18 22:03:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-b8eb5711-11ba-4c5a-a0b7-dbb64e0ce52b tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:03:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-b8eb5711-11ba-4c5a-a0b7-dbb64e0ce52b tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:03:35 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7e63b2-5165-4707-ab98-6450359da387]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:03:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-b8eb5711-11ba-4c5a-a0b7-dbb64e0ce52b tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b30f51d0-45a7-4340-ba4c-d69f36180b33 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:03:36 devstack quobyte-client[83360]: System call of process 85869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:03:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-b8eb5711-11ba-4c5a-a0b7-dbb64e0ce52b tempest-TaggedBootDevicesTest-1655784659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b30f51d0-45a7-4340-ba4c-d69f36180b33" returned: 0 in 1.143s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:03:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-b8eb5711-11ba-4c5a-a0b7-dbb64e0ce52b tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.293s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:03:37 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-b8eb5711-11ba-4c5a-a0b7-dbb64e0ce52b tempest-TaggedBootDevicesTest-1655784659 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-b30f51d0-45a7-4340-ba4c-d69f36180b33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e90292d-9997-4761-b59e-eff91ae8af15', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:03:37 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-b8eb5711-11ba-4c5a-a0b7-dbb64e0ce52b tempest-TaggedBootDevicesTest-1655784659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:03:38 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-b8eb5711-11ba-4c5a-a0b7-dbb64e0ce52b tempest-TaggedBootDevicesTest-1655784659 None] attachment_update completed successfully.
Sep 18 22:03:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:03:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:03:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:03:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:03:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:03:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:03:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:03:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.250s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:03:46 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:03:48 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:03:48 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=2,cinder:SELECT=10 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:03:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-bbef1196-b344-4648-8e10-a7a82d7c246a tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:03:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-bbef1196-b344-4648-8e10-a7a82d7c246a tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.047s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:03:50 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73e60b1-bfe5-409d-9fa8-8417eb7a1038]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:03:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-bbef1196-b344-4648-8e10-a7a82d7c246a tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:03:52 devstack quobyte-client[83360]: System call of process 85999 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:03:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-bbef1196-b344-4648-8e10-a7a82d7c246a tempest-TaggedBootDevicesTest-1655784659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9" returned: 0 in 2.509s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:03:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-bbef1196-b344-4648-8e10-a7a82d7c246a tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.990s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:03:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-bbef1196-b344-4648-8e10-a7a82d7c246a tempest-TaggedBootDevicesTest-1655784659 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b871efd-8940-40c2-82df-7d6fb49abe2c', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:03:53 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-bbef1196-b344-4648-8e10-a7a82d7c246a tempest-TaggedBootDevicesTest-1655784659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:03:55 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-38cb11b1-6377-421b-9652-a44cd7b233c2 req-bbef1196-b344-4648-8e10-a7a82d7c246a tempest-TaggedBootDevicesTest-1655784659 None] attachment_update completed successfully.
Sep 18 22:04:05 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=6 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:04:05 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:04:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:04:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:04:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:04:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:04:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:04:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.203s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:04:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:04:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.871s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:04:48 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:05:03 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:05:03 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Flow 'volume_create_manager' (d2d0c552-0828-43da-b8ad-611b7c297aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cea5bf5-4ebc-4196-9600-a0f5d8c3e117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cea5bf5-4ebc-4196-9600-a0f5d8c3e117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-966190260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa294709-8513-4b62-8611-289caccd2a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7698bd9e364f4092a451d88934d4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:05:02Z,use_quota=True,user_id='127d9e62dae2461f8f8ef154267f36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0df7826-4510-4ffb-9ea4-05c419d239f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0df7826-4510-4ffb-9ea4-05c419d239f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b745dc5a-ef4e-43b2-b657-0e51ca40d9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b745dc5a-ef4e-43b2-b657-0e51ca40d9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa294709-8513-4b62-8611-289caccd2a58', 'volume_name': 'volume-aa294709-8513-4b62-8611-289caccd2a58', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa2ae21-f29b-492f-a53d-f97879aab73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa2ae21-f29b-492f-a53d-f97879aab73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103b899a-f453-45b0-92f6-0e773739d35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:04 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Volume aa294709-8513-4b62-8611-289caccd2a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa294709-8513-4b62-8611-289caccd2a58', 'volume_size': 1}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.043s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-966190260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa294709-8513-4b62-8611-289caccd2a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a7698bd9e364f4092a451d88934d4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:05:02Z,use_quota=True,user_id='127d9e62dae2461f8f8ef154267f36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Creating volume aa294709-8513-4b62-8611-289caccd2a58 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.122s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:05:04 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:05:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-aa294709-8513-4b62-8611-289caccd2a58 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:05:05 devstack quobyte-client[83360]: System call of process 87171 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:05:05 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=9, name=volume-aa294709-8513-4b62-8611-289caccd2a58, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:05:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-aa294709-8513-4b62-8611-289caccd2a58 1073741824" returned: 0 in 1.601s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:05:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-aa294709-8513-4b62-8611-289caccd2a58 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:05:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-aa294709-8513-4b62-8611-289caccd2a58" returned: 0 in 0.618s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:05:07 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] <== create_volume: return (2656ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:05:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.736s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:05:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103b899a-f453-45b0-92f6-0e773739d35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa294709-8513-4b62-8611-289caccd2a58', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d804da-7dea-41fd-ad4e-8d05c1308ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:09 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Volume volume-aa294709-8513-4b62-8611-289caccd2a58 (aa294709-8513-4b62-8611-289caccd2a58): created successfully
Sep 18 22:05:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d804da-7dea-41fd-ad4e-8d05c1308ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Flow 'volume_create_manager' (d2d0c552-0828-43da-b8ad-611b7c297aad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:05:09 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-02a4be36-dc78-4ca5-aa4e-44df49b24a6f tempest-AttachSCSIVolumeTestJSON-984023708 None] Created volume successfully.
Sep 18 22:05:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-84e18255-2962-48fd-a5a9-a72967c50de1 req-b0a1bf38-6a36-456f-98b6-54ef2719e09f tempest-AttachSCSIVolumeTestJSON-984023708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:05:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-84e18255-2962-48fd-a5a9-a72967c50de1 req-b0a1bf38-6a36-456f-98b6-54ef2719e09f tempest-AttachSCSIVolumeTestJSON-984023708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:05:19 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f2dfb6-37fb-471f-bcbd-401a3936fb8b]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:05:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-84e18255-2962-48fd-a5a9-a72967c50de1 req-b0a1bf38-6a36-456f-98b6-54ef2719e09f tempest-AttachSCSIVolumeTestJSON-984023708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-aa294709-8513-4b62-8611-289caccd2a58 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:05:20 devstack quobyte-client[83360]: System call of process 87250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:05:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-84e18255-2962-48fd-a5a9-a72967c50de1 req-b0a1bf38-6a36-456f-98b6-54ef2719e09f tempest-AttachSCSIVolumeTestJSON-984023708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-aa294709-8513-4b62-8611-289caccd2a58" returned: 0 in 1.786s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:05:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-84e18255-2962-48fd-a5a9-a72967c50de1 req-b0a1bf38-6a36-456f-98b6-54ef2719e09f tempest-AttachSCSIVolumeTestJSON-984023708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.937s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:05:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-84e18255-2962-48fd-a5a9-a72967c50de1 req-b0a1bf38-6a36-456f-98b6-54ef2719e09f tempest-AttachSCSIVolumeTestJSON-984023708 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-aa294709-8513-4b62-8611-289caccd2a58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9209a233-3f61-4982-b411-6024444afb91', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:05:21 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-84e18255-2962-48fd-a5a9-a72967c50de1 req-b0a1bf38-6a36-456f-98b6-54ef2719e09f tempest-AttachSCSIVolumeTestJSON-984023708 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:05:22 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-84e18255-2962-48fd-a5a9-a72967c50de1 req-b0a1bf38-6a36-456f-98b6-54ef2719e09f tempest-AttachSCSIVolumeTestJSON-984023708 None] attachment_update completed successfully.
Sep 18 22:05:23 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:05:23 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:05:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Flow 'volume_create_manager' (f6410ddb-bd89-412c-a89f-6873f38601f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:05:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd17aebd-bace-4b50-a82f-18ff23c880b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd17aebd-bace-4b50-a82f-18ff23c880b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-375894603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007e76a0e33f4bb28d33eeea39e466b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:05:23Z,use_quota=True,user_id='1664eb32000f4019ab0bdb74aa7140e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c38cd9a-a5a5-4636-89cd-d24ed98c1e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c38cd9a-a5a5-4636-89cd-d24ed98c1e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (020bd6dd-26e5-4154-aeb3-b4c28c163327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (020bd6dd-26e5-4154-aeb3-b4c28c163327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8', 'volume_name': 'volume-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04184d4c-dff2-4030-bc5e-2986fb5e355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04184d4c-dff2-4030-bc5e-2986fb5e355d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4475ea1a-35e5-4abd-ab87-03f66655bb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:24 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Volume b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8', 'volume_size': 1}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-375894603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007e76a0e33f4bb28d33eeea39e466b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:05:23Z,use_quota=True,user_id='1664eb32000f4019ab0bdb74aa7140e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Creating volume b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:05:24 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:05:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:05:24 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=10, name=volume-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:05:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8 1073741824" returned: 0 in 1.157s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:05:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:05:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8" returned: 0 in 0.277s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:05:25 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] <== create_volume: return (1566ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:05:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:05:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4475ea1a-35e5-4abd-ab87-03f66655bb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80640173-fb64-479c-8279-3ae42ad8ea32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:26 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Volume volume-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8 (b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8): created successfully
Sep 18 22:05:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80640173-fb64-479c-8279-3ae42ad8ea32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Flow 'volume_create_manager' (f6410ddb-bd89-412c-a89f-6873f38601f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:05:26 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c41145a8-364a-4044-a4db-49951669c23d tempest-ServersNegativeTestJSON-1790338975 None] Created volume successfully.
Sep 18 22:05:29 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Flow 'volume_create_manager' (98aaf8b4-b4b4-45f7-90ad-4fe5769bb25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf7d79f-3a97-4cb6-9bc1-4b84c892723e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf7d79f-3a97-4cb6-9bc1-4b84c892723e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-95020108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c154ac7-7216-4773-ac27-bfefa6d382af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007e76a0e33f4bb28d33eeea39e466b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:05:29Z,use_quota=True,user_id='1664eb32000f4019ab0bdb74aa7140e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0088e418-56b0-4f92-b569-f0433af30ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0088e418-56b0-4f92-b569-f0433af30ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5774e427-4190-4cc4-bf56-3267b9f6341a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5774e427-4190-4cc4-bf56-3267b9f6341a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c154ac7-7216-4773-ac27-bfefa6d382af', 'volume_name': 'volume-9c154ac7-7216-4773-ac27-bfefa6d382af', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb1eda8-07f7-40be-ae15-175ca9038579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb1eda8-07f7-40be-ae15-175ca9038579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a0d4f8-4f82-42bc-a96e-2000e1841a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:29 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Volume 9c154ac7-7216-4773-ac27-bfefa6d382af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c154ac7-7216-4773-ac27-bfefa6d382af', 'volume_size': 1}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-95020108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c154ac7-7216-4773-ac27-bfefa6d382af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='007e76a0e33f4bb28d33eeea39e466b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:05:29Z,use_quota=True,user_id='1664eb32000f4019ab0bdb74aa7140e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Creating volume 9c154ac7-7216-4773-ac27-bfefa6d382af {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:05:29 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:05:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9c154ac7-7216-4773-ac27-bfefa6d382af 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:05:29 devstack quobyte-client[83360]: System call of process 87296 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:05:29 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=11, name=volume-9c154ac7-7216-4773-ac27-bfefa6d382af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:05:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9c154ac7-7216-4773-ac27-bfefa6d382af 1073741824" returned: 0 in 0.343s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:05:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9c154ac7-7216-4773-ac27-bfefa6d382af {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:05:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9c154ac7-7216-4773-ac27-bfefa6d382af" returned: 0 in 0.088s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:05:30 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] <== create_volume: return (502ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:05:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.530s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:05:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27a0d4f8-4f82-42bc-a96e-2000e1841a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c154ac7-7216-4773-ac27-bfefa6d382af', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c64b12a-1a97-4ffb-b5da-b5f9eebef68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:05:30 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Volume volume-9c154ac7-7216-4773-ac27-bfefa6d382af (9c154ac7-7216-4773-ac27-bfefa6d382af): created successfully
Sep 18 22:05:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c64b12a-1a97-4ffb-b5da-b5f9eebef68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:05:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Flow 'volume_create_manager' (98aaf8b4-b4b4-45f7-90ad-4fe5769bb25b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:05:30 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-3b2f1f4b-3c0d-41af-92f7-af594e448006 tempest-ServersNegativeTestJSON-1790338975 None] Created volume successfully.
Sep 18 22:05:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Acquiring lock "cinder-9c154ac7-7216-4773-ac27-bfefa6d382af-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:05:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Lock "cinder-9c154ac7-7216-4773-ac27-bfefa6d382af-delete_volume" acquired by "delete_volume" :: waited 0.141s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:05:32 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:05:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Acquiring lock "cinder-quobyte-9c154ac7-7216-4773-ac27-bfefa6d382af" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:05:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Lock "cinder-quobyte-9c154ac7-7216-4773-ac27-bfefa6d382af" acquired by "delete_volume" :: waited 0.021s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:05:32 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f86963-d467-49a5-a028-8220acdf855e]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:05:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9c154ac7-7216-4773-ac27-bfefa6d382af {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:05:33 devstack quobyte-client[83360]: System call of process 87304 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:05:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9c154ac7-7216-4773-ac27-bfefa6d382af" returned: 0 in 0.772s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:05:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9c154ac7-7216-4773-ac27-bfefa6d382af {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:05:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9c154ac7-7216-4773-ac27-bfefa6d382af" returned: 0 in 0.177s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:05:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Lock "cinder-quobyte-9c154ac7-7216-4773-ac27-bfefa6d382af" released by "delete_volume" :: held 1.207s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:05:34 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Created reservations ['618b6bb1-b9a6-4525-b223-255300c6a693', '5d4e4893-16f0-485f-a630-06906481c6fd', 'f2076bd3-f10c-422c-944b-3ac982dc233a', 'a635af16-f76d-419f-a337-b8500915afaf'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:05:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:05:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:05:34 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:05:34 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:05:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:05:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:05:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.156s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:05:34 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:05:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Acquiring lock "cinder-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:05:34 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Deleted volume successfully.
Sep 18 22:05:35 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Lock "cinder-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8-delete_volume" acquired by "delete_volume" :: waited 0.366s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:05:35 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c3ccbae2-943b-40b8-83ef-30458b4bf25d tempest-ServersNegativeTestJSON-1790338975 None] Lock "cinder-9c154ac7-7216-4773-ac27-bfefa6d382af-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:05:35 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:05:35 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Acquiring lock "cinder-quobyte-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:05:35 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Lock "cinder-quobyte-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8" acquired by "delete_volume" :: waited 0.035s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:05:35 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dace7083-6fc3-4af0-9378-73ec4ea18581]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:05:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:05:35 devstack quobyte-client[83360]: System call of process 87314 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:05:35 devstack quobyte-client[83360]: System call of process 87314 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:05:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8" returned: 0 in 0.645s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:05:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:05:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8" returned: 0 in 0.139s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:05:36 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Lock "cinder-quobyte-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8" released by "delete_volume" :: held 1.113s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:05:36 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Created reservations ['4d2b9bc6-dde4-41f7-b4c4-8aaac247c808', 'f60c1a9b-60f5-40b6-bd0b-eb87d9625143', 'fbab2e77-e608-45b7-93c1-1fcca01ab368', '60c41aa4-7510-4bdc-84b4-781488efc65a'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:05:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:05:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:05:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:05:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:05:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:05:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:05:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.290s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:05:37 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:05:37 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Deleted volume successfully.
Sep 18 22:05:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fe8acb61-8ffd-495d-b300-6cc45f9ba662 tempest-ServersNegativeTestJSON-1790338975 None] Lock "cinder-b264f347-cfc6-4bb9-9e5a-88c09d5ab9b8-delete_volume" released by "delete_volume" :: held 2.969s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:05:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:05:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:05:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:05:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:05:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:05:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:05:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:05:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.164s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:05:46 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:05:46 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=24,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=8 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:05:48 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=14,cinder:UPDATE=29,cinder:DELETE=3 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:05:51 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-febb7ce7-9cd0-4456-a730-999daac759c2 req-5a93580c-b9c3-4867-81c2-7fc672487767 tempest-AttachSCSIVolumeTestJSON-984023708 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:05:51 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-febb7ce7-9cd0-4456-a730-999daac759c2 req-5a93580c-b9c3-4867-81c2-7fc672487767 tempest-AttachSCSIVolumeTestJSON-984023708 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:05:51 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-febb7ce7-9cd0-4456-a730-999daac759c2 req-5a93580c-b9c3-4867-81c2-7fc672487767 tempest-AttachSCSIVolumeTestJSON-984023708 None] Terminate volume connection completed successfully.
Sep 18 22:05:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-febb7ce7-9cd0-4456-a730-999daac759c2 req-5a93580c-b9c3-4867-81c2-7fc672487767 tempest-AttachSCSIVolumeTestJSON-984023708 None] Deleting attachment 9209a233-3f61-4982-b411-6024444afb91. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:06:01 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:06:01 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:06:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Acquiring lock "cinder-aa294709-8513-4b62-8611-289caccd2a58-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:06:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Lock "cinder-aa294709-8513-4b62-8611-289caccd2a58-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:06:05 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:06:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Acquiring lock "cinder-quobyte-aa294709-8513-4b62-8611-289caccd2a58" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:06:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Lock "cinder-quobyte-aa294709-8513-4b62-8611-289caccd2a58" acquired by "delete_volume" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:06:05 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[342bf1ad-5ae6-405a-b981-f22395fc3b75]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:06:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-aa294709-8513-4b62-8611-289caccd2a58 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:06:05 devstack quobyte-client[83360]: System call of process 87474 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:06:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-aa294709-8513-4b62-8611-289caccd2a58" returned: 0 in 0.636s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:06:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-aa294709-8513-4b62-8611-289caccd2a58 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:06:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-aa294709-8513-4b62-8611-289caccd2a58" returned: 0 in 0.129s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:06:06 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Lock "cinder-quobyte-aa294709-8513-4b62-8611-289caccd2a58" released by "delete_volume" :: held 0.949s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:06:06 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Created reservations ['2052ee6c-9512-42b9-8eda-34a22f9faed9', '9cfb35f4-82de-4d63-b15d-0b6e4e586514', '57113db0-754b-46f3-87a4-2ee0a28e2df2', '82c50d81-eefe-4e4a-8235-0c01885ec5cb'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:06:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:06:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:06:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:06:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:06:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:06:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:06:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.229s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:06:06 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:06:07 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Deleted volume successfully.
Sep 18 22:06:07 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-28d44d55-a65e-4986-897e-e86e1a5ed959 tempest-AttachSCSIVolumeTestJSON-984023708 None] Lock "cinder-aa294709-8513-4b62-8611-289caccd2a58-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:06:16 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=3,cinder:UPDATE=10 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:06:17 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=6,cinder:SELECT=7,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:06:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:06:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:06:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:06:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:06:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:06:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.111s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:06:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:06:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.814s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:06:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:07:16 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-141455b9-4ff9-45de-be7a-0afe9b9f6272 req-fdbed2ab-3a7d-4eae-99b7-aeadb9cabbc6 tempest-TaggedBootDevicesTest-1655784659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:07:17 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-141455b9-4ff9-45de-be7a-0afe9b9f6272 req-fdbed2ab-3a7d-4eae-99b7-aeadb9cabbc6 tempest-TaggedBootDevicesTest-1655784659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:07:17 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-141455b9-4ff9-45de-be7a-0afe9b9f6272 req-fdbed2ab-3a7d-4eae-99b7-aeadb9cabbc6 tempest-TaggedBootDevicesTest-1655784659 None] Terminate volume connection completed successfully.
Sep 18 22:07:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-141455b9-4ff9-45de-be7a-0afe9b9f6272 req-fdbed2ab-3a7d-4eae-99b7-aeadb9cabbc6 tempest-TaggedBootDevicesTest-1655784659 None] Deleting attachment 570be27d-b4e6-450b-bddd-2891f7133a29. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:07:17 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-141455b9-4ff9-45de-be7a-0afe9b9f6272 req-12ed914c-b4a9-4c1d-a079-4a54c6b5d61c tempest-TaggedBootDevicesTest-1655784659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:07:17 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-141455b9-4ff9-45de-be7a-0afe9b9f6272 req-12ed914c-b4a9-4c1d-a079-4a54c6b5d61c tempest-TaggedBootDevicesTest-1655784659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:07:17 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-141455b9-4ff9-45de-be7a-0afe9b9f6272 req-12ed914c-b4a9-4c1d-a079-4a54c6b5d61c tempest-TaggedBootDevicesTest-1655784659 None] Terminate volume connection completed successfully.
Sep 18 22:07:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-141455b9-4ff9-45de-be7a-0afe9b9f6272 req-12ed914c-b4a9-4c1d-a079-4a54c6b5d61c tempest-TaggedBootDevicesTest-1655784659 None] Deleting attachment 4e90292d-9997-4761-b59e-eff91ae8af15. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:07:18 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-141455b9-4ff9-45de-be7a-0afe9b9f6272 req-b68a4ba1-a6a5-4e7f-834a-05403b20b8be tempest-TaggedBootDevicesTest-1655784659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:07:18 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-141455b9-4ff9-45de-be7a-0afe9b9f6272 req-b68a4ba1-a6a5-4e7f-834a-05403b20b8be tempest-TaggedBootDevicesTest-1655784659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:07:18 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-141455b9-4ff9-45de-be7a-0afe9b9f6272 req-b68a4ba1-a6a5-4e7f-834a-05403b20b8be tempest-TaggedBootDevicesTest-1655784659 None] Terminate volume connection completed successfully.
Sep 18 22:07:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-141455b9-4ff9-45de-be7a-0afe9b9f6272 req-b68a4ba1-a6a5-4e7f-834a-05403b20b8be tempest-TaggedBootDevicesTest-1655784659 None] Deleting attachment 3b871efd-8940-40c2-82df-7d6fb49abe2c. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:07:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "cinder-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:07:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Lock "cinder-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:07:31 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:07:31 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "cinder-quobyte-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:07:31 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Lock "cinder-quobyte-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9" acquired by "delete_volume" :: waited 0.057s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:07:31 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc128b3-216f-4c36-b4d9-47459a488ce4]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:07:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:07:31 devstack quobyte-client[83360]: System call of process 88105 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:07:31 devstack quobyte-client[83360]: System call of process 88105 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:07:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9" returned: 0 in 0.811s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:07:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:07:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9" returned: 0 in 0.178s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:07:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Lock "cinder-quobyte-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9" released by "delete_volume" :: held 1.236s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:07:32 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Created reservations ['589b9dc1-7f86-4862-be50-0bbf683962dc', '765a9724-8ba5-43ac-b465-02ac3b674b6a', 'ae690d24-e800-440d-9c3f-58b9a4ac27f6', 'ee46ee4f-c9fb-454c-b1e5-906a2af3512a'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:07:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:07:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:07:33 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:07:33 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:07:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:07:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:07:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.146s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:07:33 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:07:33 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Deleted volume successfully.
Sep 18 22:07:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "cinder-b30f51d0-45a7-4340-ba4c-d69f36180b33-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:07:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Lock "cinder-b30f51d0-45a7-4340-ba4c-d69f36180b33-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:07:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-57718c77-01d4-4bb7-9a26-f19f832b7a7d tempest-TaggedBootDevicesTest-1655784659 None] Lock "cinder-e6f39f53-4bcb-44b7-9258-15ef4b0e2cf9-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:07:33 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:07:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "cinder-quobyte-b30f51d0-45a7-4340-ba4c-d69f36180b33" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:07:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Lock "cinder-quobyte-b30f51d0-45a7-4340-ba4c-d69f36180b33" acquired by "delete_volume" :: waited 0.031s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:07:33 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[528c40b7-b8ff-4277-be3d-af9f995e76ef]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:07:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b30f51d0-45a7-4340-ba4c-d69f36180b33 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:07:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b30f51d0-45a7-4340-ba4c-d69f36180b33" returned: 0 in 0.471s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:07:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b30f51d0-45a7-4340-ba4c-d69f36180b33 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:07:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b30f51d0-45a7-4340-ba4c-d69f36180b33" returned: 0 in 0.140s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:07:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Lock "cinder-quobyte-b30f51d0-45a7-4340-ba4c-d69f36180b33" released by "delete_volume" :: held 0.848s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:07:34 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Created reservations ['6c9bf966-5c48-4798-a54f-a25b7af796f9', '43144064-7aac-40a4-bbde-5155ef02204b', 'ba033ef4-cf63-44f7-870f-c63d8ed8d70e', '14ad6ed0-9f0f-48d7-95d3-d0de7d84ee89'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:07:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:07:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:07:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:07:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:07:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:07:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:07:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.083s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:07:35 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:07:35 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Deleted volume successfully.
Sep 18 22:07:35 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-5806b4bd-5988-44f2-a305-c5a174ff45ee tempest-TaggedBootDevicesTest-1655784659 None] Lock "cinder-b30f51d0-45a7-4340-ba4c-d69f36180b33-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:07:36 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "cinder-07b2495d-6900-4b01-bb6d-32d440ddf2af-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:07:36 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Lock "cinder-07b2495d-6900-4b01-bb6d-32d440ddf2af-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:07:36 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:07:36 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "cinder-quobyte-07b2495d-6900-4b01-bb6d-32d440ddf2af" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:07:36 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Lock "cinder-quobyte-07b2495d-6900-4b01-bb6d-32d440ddf2af" acquired by "delete_volume" :: waited 0.028s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:07:36 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[21505577-5980-4ff5-8c57-09d9e7201edc]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:07:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:07:37 devstack quobyte-client[83360]: System call of process 88136 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:07:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af" returned: 0 in 1.149s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:07:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:07:38 devstack quobyte-client[83360]: System call of process 88141 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:07:38 devstack quobyte-client[83360]: System call of process 88141 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:07:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af" returned: 1 in 1.251s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:07:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:07:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:07:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-07b2495d-6900-4b01-bb6d-32d440ddf2af" returned: 0 in 0.305s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:07:39 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Lock "cinder-quobyte-07b2495d-6900-4b01-bb6d-32d440ddf2af" released by "delete_volume" :: held 3.441s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:07:40 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Created reservations ['76ca32d0-2f2f-4ba7-b46a-3373807830c3', '2fe38352-9505-4e18-adeb-f536e3147121', 'a029be58-a484-408c-9541-67db497ae18b', '8e1623ef-ff07-4900-a3f1-2082b57479f0'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:07:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:07:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:07:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:07:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:07:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:07:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:07:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.244s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:07:41 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:07:41 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Deleted volume successfully.
Sep 18 22:07:41 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3ef7543d-9830-4ba8-acb1-f764cc81f062 tempest-TaggedBootDevicesTest-1655784659 None] Lock "cinder-07b2495d-6900-4b01-bb6d-32d440ddf2af-delete_volume" released by "delete_volume" :: held 5.372s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:07:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:07:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:07:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:07:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:07:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:07:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.063s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:07:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:07:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.330s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:07:46 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:07:50 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=18,cinder:UPDATE=21,cinder:INSERT=11,cinder:DELETE=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:07:51 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=19,cinder:UPDATE=28,cinder:INSERT=1,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:08:04 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Flow 'volume_create_manager' (5557c46c-1750-4f01-bf30-a5431cb6907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac1a8e8-dca0-495e-8086-a30dc4f6aa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac1a8e8-dca0-495e-8086-a30dc4f6aa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2045577466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec278f2c-35c6-4e8a-9667-72c9af0b602c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7eb6caa60a4e9782e935d090cf47b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:08:04Z,use_quota=True,user_id='0250dbedc0094dabbf383a1293362d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9121d6e-ae7e-43bc-b07d-378c5aa61a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9121d6e-ae7e-43bc-b07d-378c5aa61a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d0364d-ac5a-400d-ba64-dc73bffd0f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d0364d-ac5a-400d-ba64-dc73bffd0f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec278f2c-35c6-4e8a-9667-72c9af0b602c', 'volume_name': 'volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6010193f-b563-4b11-beea-436a381a9bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6010193f-b563-4b11-beea-436a381a9bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c408f9-e797-43c1-ba97-d0be5ae061d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:04 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Volume ec278f2c-35c6-4e8a-9667-72c9af0b602c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c', 'volume_size': 1}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2045577466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec278f2c-35c6-4e8a-9667-72c9af0b602c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7eb6caa60a4e9782e935d090cf47b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:08:04Z,use_quota=True,user_id='0250dbedc0094dabbf383a1293362d8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Creating volume ec278f2c-35c6-4e8a-9667-72c9af0b602c {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:08:04 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:04 devstack quobyte-client[83360]: System call of process 88215 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:04 devstack quobyte-client[83360]: System call of process 88215 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:04 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=12, name=volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c 1073741824" returned: 0 in 0.348s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c" returned: 0 in 0.095s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] <== create_volume: return (531ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.543s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c408f9-e797-43c1-ba97-d0be5ae061d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea3c23e-c95f-4ce0-b129-e06324ba17ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:05 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Volume volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c (ec278f2c-35c6-4e8a-9667-72c9af0b602c): created successfully
Sep 18 22:08:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea3c23e-c95f-4ce0-b129-e06324ba17ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Flow 'volume_create_manager' (5557c46c-1750-4f01-bf30-a5431cb6907e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:08:05 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-8e96db6a-f64b-4dc9-a412-d0153704a16c req-2ef7ab0a-4707-42fa-bf7a-fa5e8f4e6401 tempest-VolumesSnapshotsTestJSON-1329460947 None] Created volume successfully.
Sep 18 22:08:05 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:05 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] Creating offline snapshot c6839e56-8999-4d69-a9b6-a56fa98ebf62 of volume ec278f2c-35c6-4e8a-9667-72c9af0b602c {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:08:05 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1bbd9b-f45c-4a77-98fe-e20b2bc69089]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:08:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:06 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:06 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:08:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Flow 'volume_create_manager' (7f50292b-0da3-4840-a065-cc6dd1127e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:08:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (524fab92-1551-4c06-9e14-238536775423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:06 devstack quobyte-client[83360]: System call of process 88222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:06 devstack quobyte-client[83360]: System call of process 88222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:06 devstack quobyte-client[83360]: System call of process 88222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (524fab92-1551-4c06-9e14-238536775423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-428789377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0154a0cc-5e50-4e9a-912f-e8d71b59b304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b2d6252c0c4ca7bc89d364c28e4fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:08:06Z,use_quota=True,user_id='179a0bb1c78b4c80afdcf9a44ee32ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6af3ced-e24c-4732-b0a3-df7c7826e6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6af3ced-e24c-4732-b0a3-df7c7826e6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9f74a6-10d1-49ab-905a-e129a6213e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac9f74a6-10d1-49ab-905a-e129a6213e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0154a0cc-5e50-4e9a-912f-e8d71b59b304', 'volume_name': 'volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5e1813-781f-44c8-9744-adbec9374f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5e1813-781f-44c8-9744-adbec9374f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ce92d3-a02a-48e5-b244-60080c1cab37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:06 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Volume 0154a0cc-5e50-4e9a-912f-e8d71b59b304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304', 'volume_size': 1}
Sep 18 22:08:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c" returned: 0 in 0.845s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:06 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=13, name=volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62 1G" returned: 0 in 0.312s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:07 devstack quobyte-client[83360]: System call of process 88228 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "qemu-img rebase -u -b volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62" returned: 0 in 0.171s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62" returned: 0 in 0.082s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62" returned: 0 in 0.089s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.info" returned: 0 in 0.093s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.info" returned: 0 in 0.104s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.264s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-428789377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0154a0cc-5e50-4e9a-912f-e8d71b59b304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b2d6252c0c4ca7bc89d364c28e4fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:08:06Z,use_quota=True,user_id='179a0bb1c78b4c80afdcf9a44ee32ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Creating volume 0154a0cc-5e50-4e9a-912f-e8d71b59b304 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:07 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:08:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:08:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:08:08 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:08:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:08 devstack quobyte-client[83360]: System call of process 88235 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:08 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=15, name=volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:08:08 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-8c79c66d-0c11-4a93-95d9-08e8d96492ac req-c5ea35af-c7a9-47bf-a6c8-f0123fa3cc52 tempest-VolumesSnapshotsTestJSON-1329460947 None] Create snapshot completed successfully
Sep 18 22:08:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304 1073741824" returned: 0 in 0.439s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304" returned: 0 in 0.097s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] <== create_volume: return (606ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:08:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.639s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ce92d3-a02a-48e5-b244-60080c1cab37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6646f978-1524-4213-881f-f4bb44322c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:08 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Volume volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304 (0154a0cc-5e50-4e9a-912f-e8d71b59b304): created successfully
Sep 18 22:08:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6646f978-1524-4213-881f-f4bb44322c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Flow 'volume_create_manager' (7f50292b-0da3-4840-a065-cc6dd1127e5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:08:08 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-9a27bdbd-6fed-4548-a90e-12527f521cc0 tempest-AttachVolumeShelveTestJSON-1275355314 None] Created volume successfully.
Sep 18 22:08:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Acquiring lock "cinder-c6839e56-8999-4d69-a9b6-a56fa98ebf62-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:08:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "cinder-c6839e56-8999-4d69-a9b6-a56fa98ebf62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:08:09 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Acquiring lock "cinder-quobyte-ec278f2c-35c6-4e8a-9667-72c9af0b602c" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:08:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "cinder-quobyte-ec278f2c-35c6-4e8a-9667-72c9af0b602c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:08:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Acquiring lock "cinder-quobyte-c6839e56-8999-4d69-a9b6-a56fa98ebf62" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:08:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "cinder-quobyte-c6839e56-8999-4d69-a9b6-a56fa98ebf62" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:08:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Deleting offline snapshot c6839e56-8999-4d69-a9b6-a56fa98ebf62 of volume ec278f2c-35c6-4e8a-9667-72c9af0b602c {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:08:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] snapshot_file for this snap is: volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:08:09 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaf3743-fadf-454c-8fba-aa3a05af20e4]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:08:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:09 devstack quobyte-client[83360]: System call of process 88240 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62" returned: 0 in 0.499s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:08:10 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04ae7a7-7dac-4609-9396-da2922cabd13]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:08:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c" returned: 0 in 0.637s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:10 devstack quobyte-client[83360]: System call of process 88271 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62" returned: 0 in 0.341s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c.c6839e56-8999-4d69-a9b6-a56fa98ebf62" returned: 0 in 0.109s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "cinder-quobyte-c6839e56-8999-4d69-a9b6-a56fa98ebf62" released by "_delete_snapshot" :: held 1.982s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:08:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "cinder-quobyte-ec278f2c-35c6-4e8a-9667-72c9af0b602c" released by "delete_snapshot" :: held 2.010s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:08:11 devstack cinder-volume[83342]: WARNING cinder.quota [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:08:11 devstack cinder-volume[83342]: DEBUG cinder.quota [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Created reservations ['97e1a82c-432d-43b1-8722-deb163c102cb', '93784b0d-cf53-4048-ba5f-1ce78f91bc8e', '637d372f-514b-4f33-b77a-8667b3430e4d', '4ba6486d-df0e-4f92-b095-8d8fcdd4e131'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:08:11 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Delete snapshot completed successfully.
Sep 18 22:08:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-c076471f-c1f3-4e6c-98a1-9329239db9b1 req-193a96f0-9637-4143-8568-73573201adaa tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "cinder-c6839e56-8999-4d69-a9b6-a56fa98ebf62-delete_snapshot" released by "delete_snapshot" :: held 2.614s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:08:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Acquiring lock "cinder-ec278f2c-35c6-4e8a-9667-72c9af0b602c-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:08:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "cinder-ec278f2c-35c6-4e8a-9667-72c9af0b602c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:08:12 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Acquiring lock "cinder-quobyte-ec278f2c-35c6-4e8a-9667-72c9af0b602c" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:08:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "cinder-quobyte-ec278f2c-35c6-4e8a-9667-72c9af0b602c" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:08:12 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac75c20-7188-4f6d-8464-e7e4d2f3762f]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:08:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:13 devstack quobyte-client[83360]: System call of process 88275 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:13 devstack quobyte-client[83360]: System call of process 88275 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:13 devstack quobyte-client[83360]: System call of process 88275 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:13 devstack quobyte-client[83360]: System call of process 88275 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c" returned: 0 in 0.701s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ec278f2c-35c6-4e8a-9667-72c9af0b602c" returned: 0 in 1.024s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "cinder-quobyte-ec278f2c-35c6-4e8a-9667-72c9af0b602c" released by "delete_volume" :: held 2.166s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:08:15 devstack cinder-volume[83342]: DEBUG cinder.quota [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Created reservations ['e52eb338-bffe-4784-bdc5-4dc5bd5bb272', '54d48479-59a4-4944-bd27-810ba94ac2fe', 'a8cb3bb7-ca2a-43d3-a557-adcdae2817e7', 'be364973-de3d-4cb8-98b9-ae82fff81e7a'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:08:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:08:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:08:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.248s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:16 devstack cinder-volume[83342]: DEBUG cinder.manager [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:08:16 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Deleted volume successfully.
Sep 18 22:08:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-bab7edf5-1d12-4d51-a63f-2cb5f6219706 req-9efb2e2b-d6bf-4c9a-a0db-0ca6d9305b7a tempest-VolumesSnapshotsTestJSON-1329460947 None] Lock "cinder-ec278f2c-35c6-4e8a-9667-72c9af0b602c-delete_volume" released by "delete_volume" :: held 3.645s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:08:20 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:20 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:08:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Flow 'volume_create_manager' (a2ee1daf-e9e6-4f75-bb98-0f7d009d1bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5649b795-23de-487f-9cc6-2fb465c43b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5649b795-23de-487f-9cc6-2fb465c43b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-406214647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8424761d-c1c4-4d52-a12b-345e3675b15c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b99aa60e8dfc4968a42e360b6490da2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:08:21Z,use_quota=True,user_id='015ef307d637427692d5e8d86b612292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee00f83-7742-4991-98d8-3e295c36c718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee00f83-7742-4991-98d8-3e295c36c718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90caf3d6-2238-4287-ac1d-4b7b463d53b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90caf3d6-2238-4287-ac1d-4b7b463d53b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8424761d-c1c4-4d52-a12b-345e3675b15c', 'volume_name': 'volume-8424761d-c1c4-4d52-a12b-345e3675b15c', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a13e5e4-0751-41fa-a062-c9307b9728f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a13e5e4-0751-41fa-a062-c9307b9728f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dacf4f8a-b705-4b21-aaba-c2d55f04f733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:21 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Volume 8424761d-c1c4-4d52-a12b-345e3675b15c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8424761d-c1c4-4d52-a12b-345e3675b15c', 'volume_size': 1}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-406214647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8424761d-c1c4-4d52-a12b-345e3675b15c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b99aa60e8dfc4968a42e360b6490da2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:08:21Z,use_quota=True,user_id='015ef307d637427692d5e8d86b612292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Creating volume 8424761d-c1c4-4d52-a12b-345e3675b15c {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:08:21 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8424761d-c1c4-4d52-a12b-345e3675b15c 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:21 devstack quobyte-client[83360]: System call of process 88326 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:21 devstack quobyte-client[83360]: System call of process 88326 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:21 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=16, name=volume-8424761d-c1c4-4d52-a12b-345e3675b15c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8424761d-c1c4-4d52-a12b-345e3675b15c 1073741824" returned: 0 in 0.405s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8424761d-c1c4-4d52-a12b-345e3675b15c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8424761d-c1c4-4d52-a12b-345e3675b15c" returned: 0 in 0.099s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] <== create_volume: return (573ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.587s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dacf4f8a-b705-4b21-aaba-c2d55f04f733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8424761d-c1c4-4d52-a12b-345e3675b15c', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f25adfd-4a98-4e2a-9700-8412ee84a3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:21 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Volume volume-8424761d-c1c4-4d52-a12b-345e3675b15c (8424761d-c1c4-4d52-a12b-345e3675b15c): created successfully
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f25adfd-4a98-4e2a-9700-8412ee84a3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Flow 'volume_create_manager' (a2ee1daf-e9e6-4f75-bb98-0f7d009d1bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:08:21 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a305ac2d-2937-4e1e-8cfd-d4f6593a489e tempest-VolumesTestJSON-651952526 None] Created volume successfully.
Sep 18 22:08:23 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Flow 'volume_create_manager' (b7da8c13-d3a1-4cc2-8322-4ec3feddd224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4ac477-aade-4434-a565-1780f8f04b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4ac477-aade-4434-a565-1780f8f04b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1160639102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4837fda4-829b-4efe-b455-4c4698d4fbee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b99aa60e8dfc4968a42e360b6490da2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:08:23Z,use_quota=True,user_id='015ef307d637427692d5e8d86b612292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2687e2bb-63c3-4537-815f-39c1fd2f2c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2687e2bb-63c3-4537-815f-39c1fd2f2c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab6f729-3695-4d12-995a-40ea0bd794bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab6f729-3695-4d12-995a-40ea0bd794bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4837fda4-829b-4efe-b455-4c4698d4fbee', 'volume_name': 'volume-4837fda4-829b-4efe-b455-4c4698d4fbee', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456ba78f-5bb1-4c3a-8da5-ae2fb7f51e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456ba78f-5bb1-4c3a-8da5-ae2fb7f51e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef9ae72-3ee7-4ec0-ac4a-81f3d77acb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:23 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Volume 4837fda4-829b-4efe-b455-4c4698d4fbee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4837fda4-829b-4efe-b455-4c4698d4fbee', 'volume_size': 1}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1160639102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4837fda4-829b-4efe-b455-4c4698d4fbee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b99aa60e8dfc4968a42e360b6490da2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:08:23Z,use_quota=True,user_id='015ef307d637427692d5e8d86b612292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Creating volume 4837fda4-829b-4efe-b455-4c4698d4fbee {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:08:23 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4837fda4-829b-4efe-b455-4c4698d4fbee 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:23 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=17, name=volume-4837fda4-829b-4efe-b455-4c4698d4fbee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4837fda4-829b-4efe-b455-4c4698d4fbee 1073741824" returned: 0 in 0.312s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4837fda4-829b-4efe-b455-4c4698d4fbee {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4837fda4-829b-4efe-b455-4c4698d4fbee" returned: 0 in 0.104s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] <== create_volume: return (486ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:08:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.497s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef9ae72-3ee7-4ec0-ac4a-81f3d77acb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4837fda4-829b-4efe-b455-4c4698d4fbee', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe440977-4e9f-474d-aa8c-23bf76c9c5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:24 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Volume volume-4837fda4-829b-4efe-b455-4c4698d4fbee (4837fda4-829b-4efe-b455-4c4698d4fbee): created successfully
Sep 18 22:08:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe440977-4e9f-474d-aa8c-23bf76c9c5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Flow 'volume_create_manager' (b7da8c13-d3a1-4cc2-8322-4ec3feddd224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:08:24 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-56742313-db45-4bfe-85d2-29de6e6df706 tempest-VolumesTestJSON-651952526 None] Created volume successfully.
Sep 18 22:08:26 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Flow 'volume_create_manager' (44fa30d0-4a32-4557-a286-e5d7c0200d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97fdad6-5a87-4d5b-9d57-bcf6095eac9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97fdad6-5a87-4d5b-9d57-bcf6095eac9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1925025231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541fcbe3-4e01-4755-ad47-29df4893c4b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b99aa60e8dfc4968a42e360b6490da2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:08:26Z,use_quota=True,user_id='015ef307d637427692d5e8d86b612292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cf4a58-3582-4677-8755-49c2fbf8ab49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77cf4a58-3582-4677-8755-49c2fbf8ab49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3457854-a47b-4e15-a561-6f6705ad4686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3457854-a47b-4e15-a561-6f6705ad4686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '541fcbe3-4e01-4755-ad47-29df4893c4b9', 'volume_name': 'volume-541fcbe3-4e01-4755-ad47-29df4893c4b9', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70caf30d-3f9b-43c2-a8a0-ddf54a12ff28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70caf30d-3f9b-43c2-a8a0-ddf54a12ff28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241c7f5e-cb5c-4a3e-b72e-cd1f2660d2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:26 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Volume 541fcbe3-4e01-4755-ad47-29df4893c4b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-541fcbe3-4e01-4755-ad47-29df4893c4b9', 'volume_size': 1}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1925025231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=541fcbe3-4e01-4755-ad47-29df4893c4b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b99aa60e8dfc4968a42e360b6490da2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:08:26Z,use_quota=True,user_id='015ef307d637427692d5e8d86b612292',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Creating volume 541fcbe3-4e01-4755-ad47-29df4893c4b9 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:08:26 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-541fcbe3-4e01-4755-ad47-29df4893c4b9 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:26 devstack quobyte-client[83360]: System call of process 88341 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:26 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=18, name=volume-541fcbe3-4e01-4755-ad47-29df4893c4b9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-541fcbe3-4e01-4755-ad47-29df4893c4b9 1073741824" returned: 0 in 0.408s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-541fcbe3-4e01-4755-ad47-29df4893c4b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-541fcbe3-4e01-4755-ad47-29df4893c4b9" returned: 0 in 0.097s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] <== create_volume: return (586ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:08:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.600s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241c7f5e-cb5c-4a3e-b72e-cd1f2660d2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-541fcbe3-4e01-4755-ad47-29df4893c4b9', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36be839-d44b-44d9-b677-fb990822749c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:27 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Volume volume-541fcbe3-4e01-4755-ad47-29df4893c4b9 (541fcbe3-4e01-4755-ad47-29df4893c4b9): created successfully
Sep 18 22:08:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36be839-d44b-44d9-b677-fb990822749c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Flow 'volume_create_manager' (44fa30d0-4a32-4557-a286-e5d7c0200d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:08:27 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-8615d4a3-56ce-4658-aea6-23e67c37fa20 tempest-VolumesTestJSON-651952526 None] Created volume successfully.
Sep 18 22:08:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Acquiring lock "cinder-541fcbe3-4e01-4755-ad47-29df4893c4b9-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:08:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Lock "cinder-541fcbe3-4e01-4755-ad47-29df4893c4b9-delete_volume" acquired by "delete_volume" :: waited 0.168s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:08:29 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Acquiring lock "cinder-quobyte-541fcbe3-4e01-4755-ad47-29df4893c4b9" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:08:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Lock "cinder-quobyte-541fcbe3-4e01-4755-ad47-29df4893c4b9" acquired by "delete_volume" :: waited 0.014s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:08:29 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89a01b3-ec73-4518-acc5-d813099ed892]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:08:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-541fcbe3-4e01-4755-ad47-29df4893c4b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-541fcbe3-4e01-4755-ad47-29df4893c4b9" returned: 0 in 0.616s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-541fcbe3-4e01-4755-ad47-29df4893c4b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-541fcbe3-4e01-4755-ad47-29df4893c4b9" returned: 0 in 0.173s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Lock "cinder-quobyte-541fcbe3-4e01-4755-ad47-29df4893c4b9" released by "delete_volume" :: held 1.009s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:08:31 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Created reservations ['3538d7aa-3bf3-4c56-acb4-24c7d9bceffb', '8e2a7ea4-d09c-4eb6-ae0b-a561a2bf6f7e', '5efdbd0b-6b33-47af-890d-77fb277a2473', '1c64f554-e67e-42bd-8dd4-5d98d1085626'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:08:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:08:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:08:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.143s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:31 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:08:31 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Deleted volume successfully.
Sep 18 22:08:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Acquiring lock "cinder-4837fda4-829b-4efe-b455-4c4698d4fbee-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:08:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-91411d11-64d0-4e1d-b0fa-0d8b98b19d9d tempest-VolumesTestJSON-651952526 None] Lock "cinder-541fcbe3-4e01-4755-ad47-29df4893c4b9-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:08:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Lock "cinder-4837fda4-829b-4efe-b455-4c4698d4fbee-delete_volume" acquired by "delete_volume" :: waited 0.185s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:08:32 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Acquiring lock "cinder-quobyte-4837fda4-829b-4efe-b455-4c4698d4fbee" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:08:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Lock "cinder-quobyte-4837fda4-829b-4efe-b455-4c4698d4fbee" acquired by "delete_volume" :: waited 0.016s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:08:32 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e0e2e4-2f3d-44cc-af5d-1618bdd8a7e5]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:08:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4837fda4-829b-4efe-b455-4c4698d4fbee {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:32 devstack quobyte-client[83360]: System call of process 88357 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4837fda4-829b-4efe-b455-4c4698d4fbee" returned: 0 in 0.505s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4837fda4-829b-4efe-b455-4c4698d4fbee {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4837fda4-829b-4efe-b455-4c4698d4fbee" returned: 0 in 0.103s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Lock "cinder-quobyte-4837fda4-829b-4efe-b455-4c4698d4fbee" released by "delete_volume" :: held 0.802s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:08:33 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Created reservations ['61c9fe95-b329-468b-bbb4-9ddbcb551afc', '6724caca-5abc-417e-be6d-aa9f61fc9482', '5d58e6f8-4f6f-4491-93c2-15224157ae02', '17b7bbce-72f8-4f88-805e-de502d4c21cf'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:08:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:33 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:08:33 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:08:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.090s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:33 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:08:33 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Deleted volume successfully.
Sep 18 22:08:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3027d34d-f8d6-4b48-a9ee-a21f851ac1ac tempest-VolumesTestJSON-651952526 None] Lock "cinder-4837fda4-829b-4efe-b455-4c4698d4fbee-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:08:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Acquiring lock "cinder-8424761d-c1c4-4d52-a12b-345e3675b15c-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:08:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Lock "cinder-8424761d-c1c4-4d52-a12b-345e3675b15c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:08:34 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Acquiring lock "cinder-quobyte-8424761d-c1c4-4d52-a12b-345e3675b15c" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:08:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Lock "cinder-quobyte-8424761d-c1c4-4d52-a12b-345e3675b15c" acquired by "delete_volume" :: waited 0.015s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:08:34 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a25e720-36ab-4f0c-86f5-32cfd1daf810]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:08:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8424761d-c1c4-4d52-a12b-345e3675b15c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8424761d-c1c4-4d52-a12b-345e3675b15c" returned: 0 in 0.475s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8424761d-c1c4-4d52-a12b-345e3675b15c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8424761d-c1c4-4d52-a12b-345e3675b15c" returned: 0 in 0.134s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:35 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Lock "cinder-quobyte-8424761d-c1c4-4d52-a12b-345e3675b15c" released by "delete_volume" :: held 0.829s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:08:35 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Created reservations ['5b6a43ff-951c-4224-8fda-b9e8b6f1eee4', '8da6486e-8cfd-49fe-b588-f3f708c9a0d7', 'b9472db9-b4f8-4d74-8587-a0cef57c11c5', '9075f293-8e8e-4985-b4b1-58ad8fdc4e33'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:08:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:08:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:08:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.211s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:36 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:08:36 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Deleted volume successfully.
Sep 18 22:08:36 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d44bf4a9-5b80-42ae-8e7a-5ef7e99e23f1 tempest-VolumesTestJSON-651952526 None] Lock "cinder-8424761d-c1c4-4d52-a12b-345e3675b15c-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:08:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-e39ab841-def8-4210-8b6b-8b718623084f req-e62a4ba5-8533-4fe9-bf7b-43b560f171a6 tempest-AttachVolumeShelveTestJSON-1275355314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-e39ab841-def8-4210-8b6b-8b718623084f req-e62a4ba5-8533-4fe9-bf7b-43b560f171a6 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:36 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb90a6b-4bc3-44b3-8f71-958d26ce3908]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:08:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-e39ab841-def8-4210-8b6b-8b718623084f req-e62a4ba5-8533-4fe9-bf7b-43b560f171a6 tempest-AttachVolumeShelveTestJSON-1275355314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:37 devstack quobyte-client[83360]: System call of process 88385 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:37 devstack quobyte-client[83360]: System call of process 88385 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:37 devstack quobyte-client[83360]: System call of process 88385 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-e39ab841-def8-4210-8b6b-8b718623084f req-e62a4ba5-8533-4fe9-bf7b-43b560f171a6 tempest-AttachVolumeShelveTestJSON-1275355314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304" returned: 0 in 0.882s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-e39ab841-def8-4210-8b6b-8b718623084f req-e62a4ba5-8533-4fe9-bf7b-43b560f171a6 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.994s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-e39ab841-def8-4210-8b6b-8b718623084f req-e62a4ba5-8533-4fe9-bf7b-43b560f171a6 tempest-AttachVolumeShelveTestJSON-1275355314 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0137c45-6996-4e1f-8f56-7e7bd256d340', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:08:38 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-e39ab841-def8-4210-8b6b-8b718623084f req-e62a4ba5-8533-4fe9-bf7b-43b560f171a6 tempest-AttachVolumeShelveTestJSON-1275355314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:38 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-e39ab841-def8-4210-8b6b-8b718623084f req-e62a4ba5-8533-4fe9-bf7b-43b560f171a6 tempest-AttachVolumeShelveTestJSON-1275355314 None] attachment_update completed successfully.
Sep 18 22:08:42 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-4ca06f35-7c6e-4739-b15e-e7a2b002957e tempest-GroupSnapshotsV319Test-1290537153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:42 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-4ca06f35-7c6e-4739-b15e-e7a2b002957e tempest-GroupSnapshotsV319Test-1290537153 None] Group tempest-GroupSnapshotsV319Test-Group-1118998756: creating
Sep 18 22:08:42 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-4ca06f35-7c6e-4739-b15e-e7a2b002957e tempest-GroupSnapshotsV319Test-1290537153 None] Group tempest-GroupSnapshotsV319Test-Group-1118998756: created successfully
Sep 18 22:08:42 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-4ca06f35-7c6e-4739-b15e-e7a2b002957e tempest-GroupSnapshotsV319Test-1290537153 None] Create group completed successfully.
Sep 18 22:08:44 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Flow 'volume_create_manager' (22a08e4f-995e-475a-b212-3374bbcd77a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8266175-1745-4ce6-8ba8-95ac25fc1f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8266175-1745-4ce6-8ba8-95ac25fc1f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1435362791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f1760ef3-083c-4839-b81e-94eef466b8c4,host='devstack@QuobyteHD#QuobyteHD',id=c2cc36cf-db27-4889-920f-a006524156db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4406a16f76604aafaf15e44acc965c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:08:44Z,use_quota=True,user_id='eb765b0b0b4e4f749585784551ffa961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ad7ef5e-cdde-4bef-be18-a6b8a1084a01),volume_type_id=7ad7ef5e-cdde-4bef-be18-a6b8a1084a01)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407656e4-5d7e-4a40-8a7b-1e87649f35eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (407656e4-5d7e-4a40-8a7b-1e87649f35eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290f42ec-56a3-4c83-8a5e-1ac89d0dc32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (290f42ec-56a3-4c83-8a5e-1ac89d0dc32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2cc36cf-db27-4889-920f-a006524156db', 'volume_name': 'volume-c2cc36cf-db27-4889-920f-a006524156db', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2699426-2c72-4b6f-9f81-b019b0df10f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2699426-2c72-4b6f-9f81-b019b0df10f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7aa98c-8c74-4424-8262-4f2e334f4b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:44 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Volume c2cc36cf-db27-4889-920f-a006524156db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2cc36cf-db27-4889-920f-a006524156db', 'volume_size': 1}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f1760ef3-083c-4839-b81e-94eef466b8c4,created_at=2025-09-18T20:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1435362791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f1760ef3-083c-4839-b81e-94eef466b8c4,host='devstack@QuobyteHD#QuobyteHD',id=c2cc36cf-db27-4889-920f-a006524156db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4406a16f76604aafaf15e44acc965c9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:08:44Z,use_quota=True,user_id='eb765b0b0b4e4f749585784551ffa961',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ad7ef5e-cdde-4bef-be18-a6b8a1084a01),volume_type_id=7ad7ef5e-cdde-4bef-be18-a6b8a1084a01)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Creating volume c2cc36cf-db27-4889-920f-a006524156db {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:08:44 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:44 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=19, name=volume-c2cc36cf-db27-4889-920f-a006524156db, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db 1073741824" returned: 0 in 0.361s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db" returned: 0 in 0.114s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] <== create_volume: return (567ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:08:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.579s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7aa98c-8c74-4424-8262-4f2e334f4b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2cc36cf-db27-4889-920f-a006524156db', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082a01b8-07bd-48fc-b2eb-43db4952b320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:45 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Volume volume-c2cc36cf-db27-4889-920f-a006524156db (c2cc36cf-db27-4889-920f-a006524156db): created successfully
Sep 18 22:08:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082a01b8-07bd-48fc-b2eb-43db4952b320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Flow 'volume_create_manager' (22a08e4f-995e-475a-b212-3374bbcd77a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:08:45 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-0271dbfd-9fdd-4bc2-89f1-ed066dca3e64 tempest-GroupSnapshotsV319Test-1290537153 None] Created volume successfully.
Sep 18 22:08:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:08:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:08:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:08:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.367s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:46 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:08:47 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] GroupSnapshot dd626083-9471-4089-9389-d5c5ae34e648: creating.
Sep 18 22:08:47 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:47 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] Group snapshot dd626083-9471-4089-9389-d5c5ae34e648: creating. {{(pid=83342) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 22:08:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] Creating offline snapshot be8913eb-ea14-4b87-861d-9047baddfefb of volume c2cc36cf-db27-4889-920f-a006524156db {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:08:47 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[54833edf-5246-4705-b2ce-a12a4eb5cda0]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:08:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:48 devstack quobyte-client[83360]: System call of process 88403 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db" returned: 0 in 0.494s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:48 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=20, name=volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:08:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb 1G" returned: 0 in 0.270s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c2cc36cf-db27-4889-920f-a006524156db -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:48 devstack quobyte-client[83360]: System call of process 88410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:48 devstack quobyte-client[83360]: System call of process 88410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] CMD "qemu-img rebase -u -b volume-c2cc36cf-db27-4889-920f-a006524156db -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb" returned: 0 in 0.183s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:08:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb" returned: 0 in 0.147s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:08:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb" returned: 0 in 0.404s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.info" returned: 0 in 0.275s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:08:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.info" returned: 0 in 0.134s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:50 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:50 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Flow 'volume_create_manager' (f7fb4445-ca2f-468e-97d3-76f825fce1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94b353a-47ef-4e4f-a414-9a490d3d6882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94b353a-47ef-4e4f-a414-9a490d3d6882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1077444272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0bf6a603d834826bcdcdca9ab8a6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:08:50Z,use_quota=True,user_id='0c30399c19374fd6bdfc764ff35b042f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701b7356-0cb5-4472-8fd5-f4ff6fc06695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701b7356-0cb5-4472-8fd5-f4ff6fc06695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d892adad-71c5-46e3-8b3b-5caae18cbc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d892adad-71c5-46e3-8b3b-5caae18cbc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7f8cc8f-21d9-4bd7-9858-dda7d23f6e99', 'volume_name': 'volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc19d3e7-929d-4516-a4da-4d120678e2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc19d3e7-929d-4516-a4da-4d120678e2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca06178-7420-4b64-ae55-1aaeeff5ae79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:51 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Volume d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99', 'volume_size': 1}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1077444272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0bf6a603d834826bcdcdca9ab8a6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:08:50Z,use_quota=True,user_id='0c30399c19374fd6bdfc764ff35b042f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Creating volume d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:08:51 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:08:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:51 devstack quobyte-client[83360]: System call of process 88419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:51 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=22, name=volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:08:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99 1073741824" returned: 0 in 0.735s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:52 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a001496e-d282-4235-83e2-8dfac4643278 tempest-GroupSnapshotsV319Test-1290537153 None] group_snapshot dd626083-9471-4089-9389-d5c5ae34e648: created successfully
Sep 18 22:08:53 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] group_snapshot dd626083-9471-4089-9389-d5c5ae34e648: deleting
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99" returned: 0 in 0.934s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:53 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] group_snapshot dd626083-9471-4089-9389-d5c5ae34e648: deleting {{(pid=83342) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] <== create_volume: return (1817ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Acquiring lock "cinder-quobyte-c2cc36cf-db27-4889-920f-a006524156db" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Lock "cinder-quobyte-c2cc36cf-db27-4889-920f-a006524156db" acquired by "delete_snapshot" :: waited 0.083s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Acquiring lock "cinder-quobyte-be8913eb-ea14-4b87-861d-9047baddfefb" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Lock "cinder-quobyte-be8913eb-ea14-4b87-861d-9047baddfefb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Deleting offline snapshot be8913eb-ea14-4b87-861d-9047baddfefb of volume c2cc36cf-db27-4889-920f-a006524156db {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] snapshot_file for this snap is: volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca06178-7420-4b64-ae55-1aaeeff5ae79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a457ed64-860f-4efd-86c6-b3df298b701f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab3a602-c6d7-4133-a94a-1fea4646d187]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:53 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Volume volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99 (d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99): created successfully
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a457ed64-860f-4efd-86c6-b3df298b701f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:08:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Flow 'volume_create_manager' (f7fb4445-ca2f-468e-97d3-76f825fce1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:08:54 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e783b31a-ba74-4412-a79f-473a9379fed1 tempest-AttachVolumeNegativeTest-1277586577 None] Created volume successfully.
Sep 18 22:08:54 devstack quobyte-client[83360]: System call of process 88434 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb" returned: 0 in 1.382s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2cc36cf-db27-4889-920f-a006524156db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:08:54 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa28fb3-4650-46e0-9d07-c5986a4cc384]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:08:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:55 devstack quobyte-client[83360]: System call of process 88471 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db" returned: 0 in 0.817s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:56 devstack quobyte-client[83360]: System call of process 88479 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:56 devstack quobyte-client[83360]: System call of process 88479 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb" returned: 0 in 0.395s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db.be8913eb-ea14-4b87-861d-9047baddfefb" returned: 0 in 0.147s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:08:56 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Lock "cinder-quobyte-be8913eb-ea14-4b87-861d-9047baddfefb" released by "_delete_snapshot" :: held 3.265s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:08:56 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Lock "cinder-quobyte-c2cc36cf-db27-4889-920f-a006524156db" released by "delete_snapshot" :: held 3.301s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:08:57 devstack cinder-volume[83342]: WARNING cinder.quota [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1165805762 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1165805762, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:08:57 devstack cinder-volume[83342]: WARNING cinder.quota [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1165805762 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1165805762, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:08:57 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] Created reservations ['d770be69-301f-4ed0-9472-70df30188b53', 'f5599bd3-8974-444c-9747-6f1bf28376aa', 'f0fe0bb8-01cd-474c-a73a-04ca0a87817a', '791d0d8d-2cec-4d02-9212-60c581e11bc2'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:08:57 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-08c8d14b-47e5-4547-ac5c-718b59e68aea tempest-GroupSnapshotsV319Test-1290537153 None] group_snapshot dd626083-9471-4089-9389-d5c5ae34e648: deleted successfully
Sep 18 22:08:59 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:08:59 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Acquiring lock "cinder-quobyte-c2cc36cf-db27-4889-920f-a006524156db" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:08:59 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Lock "cinder-quobyte-c2cc36cf-db27-4889-920f-a006524156db" acquired by "delete_volume" :: waited 0.018s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:08:59 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9289b54e-28c1-4a95-9944-93662f724203]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:08:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-a168fb69-c970-4a03-8459-1c7dccf875ba req-a904a9c2-8583-49ef-bee7-11c8fd52b9f1 tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:08:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-a168fb69-c970-4a03-8459-1c7dccf875ba req-a904a9c2-8583-49ef-bee7-11c8fd52b9f1 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:08:59 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d1bcc1-2fcf-4475-9edf-a81b1f609b5a]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:08:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-a168fb69-c970-4a03-8459-1c7dccf875ba req-a904a9c2-8583-49ef-bee7-11c8fd52b9f1 tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:08:59 devstack quobyte-client[83360]: System call of process 88508 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:59 devstack quobyte-client[83360]: System call of process 88508 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:08:59 devstack quobyte-client[83360]: System call of process 88508 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:09:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db" returned: 0 in 0.738s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c2cc36cf-db27-4889-920f-a006524156db" returned: 0 in 0.223s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:00 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Lock "cinder-quobyte-c2cc36cf-db27-4889-920f-a006524156db" released by "delete_volume" :: held 1.292s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:09:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-a168fb69-c970-4a03-8459-1c7dccf875ba req-a904a9c2-8583-49ef-bee7-11c8fd52b9f1 tempest-AttachVolumeNegativeTest-1277586577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99" returned: 0 in 0.930s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-a168fb69-c970-4a03-8459-1c7dccf875ba req-a904a9c2-8583-49ef-bee7-11c8fd52b9f1 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.967s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:09:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-a168fb69-c970-4a03-8459-1c7dccf875ba req-a904a9c2-8583-49ef-bee7-11c8fd52b9f1 tempest-AttachVolumeNegativeTest-1277586577 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4eef307d-385c-490a-b879-20c6ccb7bb8a', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:09:00 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-a168fb69-c970-4a03-8459-1c7dccf875ba req-a904a9c2-8583-49ef-bee7-11c8fd52b9f1 tempest-AttachVolumeNegativeTest-1277586577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:09:00 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=59,cinder:UPDATE=59,cinder:DELETE=5,cinder:INSERT=19 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:09:01 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Created reservations ['9c3785d1-0227-48b4-a160-6dca02ddebcd'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:09:01 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-a168fb69-c970-4a03-8459-1c7dccf875ba req-a904a9c2-8583-49ef-bee7-11c8fd52b9f1 tempest-AttachVolumeNegativeTest-1277586577 None] attachment_update completed successfully.
Sep 18 22:09:01 devstack cinder-volume[83342]: WARNING cinder.quota [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1165805762 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1165805762, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:09:01 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Created reservations ['da8c7388-658f-46b7-9032-d20a91959f05', 'a52dde83-4bf4-4866-82e3-aa3bdf160252', 'a20bf819-e20d-4566-988c-b36c811dc675', 'd930fe70-4958-4a66-bfa0-254ee42f3dc0'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:09:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:09:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:09:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:09:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:09:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:09:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.156s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:01 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:09:01 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-2e2dc40d-ed56-48c5-b522-af90da37713a tempest-GroupSnapshotsV319Test-1290537153 None] Delete group completed successfully.
Sep 18 22:09:08 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=86,cinder:SELECT=66,cinder:DELETE=7,cinder:INSERT=9 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:09:08 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:09:08 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:09:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Flow 'volume_create_manager' (765adfea-29af-461c-820c-4a075fdce1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:09:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe5f556-fbf4-423d-a440-9d7b9d53a411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe5f556-fbf4-423d-a440-9d7b9d53a411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2146206272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb8cd4d6-b616-473b-a365-7388ddb38531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a27dbb30d5f4ad1bd34ad0447cc3418',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:09:08Z,use_quota=True,user_id='c9bfdf1e9d214d638fc45166b6a94d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d20d70-128d-4b6a-b962-6e0d112ac422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d20d70-128d-4b6a-b962-6e0d112ac422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5c0ec2-6d80-4173-881f-295d64992b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5c0ec2-6d80-4173-881f-295d64992b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb8cd4d6-b616-473b-a365-7388ddb38531', 'volume_name': 'volume-eb8cd4d6-b616-473b-a365-7388ddb38531', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaaf4aa4-b378-43ba-8b2e-52f0a238068a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaaf4aa4-b378-43ba-8b2e-52f0a238068a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa798d15-6358-4d56-bcec-8c8c8ba1e8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:09 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Volume eb8cd4d6-b616-473b-a365-7388ddb38531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb8cd4d6-b616-473b-a365-7388ddb38531', 'volume_size': 1}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2146206272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb8cd4d6-b616-473b-a365-7388ddb38531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a27dbb30d5f4ad1bd34ad0447cc3418',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:09:08Z,use_quota=True,user_id='c9bfdf1e9d214d638fc45166b6a94d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Creating volume eb8cd4d6-b616-473b-a365-7388ddb38531 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:09:09 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:09:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:09 devstack quobyte-client[83360]: System call of process 88944 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:09:09 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=23, name=volume-eb8cd4d6-b616-473b-a365-7388ddb38531, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:09:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531 1073741824" returned: 0 in 0.943s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531" returned: 0 in 0.637s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] <== create_volume: return (1855ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:09:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:09:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa798d15-6358-4d56-bcec-8c8c8ba1e8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb8cd4d6-b616-473b-a365-7388ddb38531', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0d5c4d-9962-4268-ba51-38c9e0dd0654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:11 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Volume volume-eb8cd4d6-b616-473b-a365-7388ddb38531 (eb8cd4d6-b616-473b-a365-7388ddb38531): created successfully
Sep 18 22:09:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0d5c4d-9962-4268-ba51-38c9e0dd0654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Flow 'volume_create_manager' (765adfea-29af-461c-820c-4a075fdce1e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:09:11 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-d8244716-bb33-49d5-a654-0df55cfbd6b1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Created volume successfully.
Sep 18 22:09:12 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:09:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:09:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.028s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:09:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Creating offline snapshot 5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3 of volume eb8cd4d6-b616-473b-a365-7388ddb38531 {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:09:12 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[34160d55-3b00-43e4-8557-ed0debb5fa85]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:09:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:13 devstack quobyte-client[83360]: System call of process 88984 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:09:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531" returned: 0 in 0.938s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:14 devstack quobyte-client[83360]: System call of process 88994 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:09:14 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=24, name=volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:09:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3 1G" returned: 0 in 0.738s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): qemu-img rebase -u -b volume-eb8cd4d6-b616-473b-a365-7388ddb38531 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "qemu-img rebase -u -b volume-eb8cd4d6-b616-473b-a365-7388ddb38531 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3" returned: 0 in 0.193s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:09:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3" returned: 0 in 0.120s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:09:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3" returned: 0 in 0.161s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.info" returned: 0 in 0.118s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:09:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.info" returned: 0 in 0.163s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.131s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:09:16 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-dd8d9691-1a8b-4467-a743-f912aec54fb1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Create snapshot completed successfully
Sep 18 22:09:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Acquiring lock "cinder-5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:09:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "cinder-5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.103s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:09:17 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:09:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Acquiring lock "cinder-quobyte-eb8cd4d6-b616-473b-a365-7388ddb38531" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:09:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "cinder-quobyte-eb8cd4d6-b616-473b-a365-7388ddb38531" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:09:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Acquiring lock "cinder-quobyte-5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:09:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "cinder-quobyte-5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:09:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Deleting offline snapshot 5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3 of volume eb8cd4d6-b616-473b-a365-7388ddb38531 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:09:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] snapshot_file for this snap is: volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:09:17 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1d1cf5-1455-46ab-931b-4234a2781fd9]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:09:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3" returned: 0 in 0.514s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb8cd4d6-b616-473b-a365-7388ddb38531(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:09:18 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7251d1a5-cbbc-45bf-9fd1-67387c28d9e3]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:09:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531" returned: 0 in 0.409s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3" returned: 0 in 0.246s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531.5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3" returned: 0 in 0.150s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:19 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "cinder-quobyte-5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3" released by "_delete_snapshot" :: held 1.725s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:09:19 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "cinder-quobyte-eb8cd4d6-b616-473b-a365-7388ddb38531" released by "delete_snapshot" :: held 1.755s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:09:19 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Created reservations ['e37fb5c0-0068-416f-a93a-057496992718', 'be88c676-23e0-46ad-a6aa-4fcf7e0113ad', '57502408-ffbb-4b71-8b83-00af0af272fb', '262a6f48-6ec0-4042-9dbf-f61831f635d6'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:09:19 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Delete snapshot completed successfully.
Sep 18 22:09:19 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-88e843a3-b044-4ee0-a9b1-18571e6a0c48 tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "cinder-5c2b6e39-7b2c-4be2-91c9-2efe62c2dbc3-delete_snapshot" released by "delete_snapshot" :: held 2.259s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:09:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Acquiring lock "cinder-eb8cd4d6-b616-473b-a365-7388ddb38531-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:09:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "cinder-eb8cd4d6-b616-473b-a365-7388ddb38531-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:09:20 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:09:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Acquiring lock "cinder-quobyte-eb8cd4d6-b616-473b-a365-7388ddb38531" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:09:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "cinder-quobyte-eb8cd4d6-b616-473b-a365-7388ddb38531" acquired by "delete_volume" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:09:21 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa47efbb-be4a-4995-95a3-db1631e32061]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:09:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:21 devstack quobyte-client[83360]: System call of process 89034 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:09:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531" returned: 0 in 0.786s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-eb8cd4d6-b616-473b-a365-7388ddb38531" returned: 0 in 0.205s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "cinder-quobyte-eb8cd4d6-b616-473b-a365-7388ddb38531" released by "delete_volume" :: held 1.268s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:09:22 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Created reservations ['c7b0a3c5-7a3b-424b-bfa9-54377a929d6b', 'bccf9dbb-f354-4511-8f60-2cbb5eb42d23', '8ac390f8-d9fd-4d9e-a75b-ba77ca201804', '4cd7762b-9fb2-46fb-a4ff-c5179e71b448'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:09:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:09:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.032s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:09:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:09:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:09:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.090s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:09:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.442s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:23 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:09:23 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Deleted volume successfully.
Sep 18 22:09:24 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-21a07f63-0ca3-4c2a-87ed-3fd4aef37afe tempest-VolumeSnapshotQuotasNegativeTestJSON-1103668971 None] Lock "cinder-eb8cd4d6-b616-473b-a365-7388ddb38531-delete_volume" released by "delete_volume" :: held 3.678s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:09:34 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=13,cinder:DELETE=2,cinder:SELECT=11,cinder:INSERT=4 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:09:34 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=22,cinder:INSERT=5,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:09:43 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Flow 'volume_create_manager' (0388b47a-e122-4d8f-9d53-acfbe31d2ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1451a86e-e09c-4011-8107-5e7895d1f5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1451a86e-e09c-4011-8107-5e7895d1f5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-917412712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fb4e9a-f8fa-4b30-9cab-503e767d2f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ddf70e507643fabf90b7f4c029c737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:09:43Z,use_quota=True,user_id='4873f35bec6a44d5ab06f44e2e79db15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d019d5-44a0-4bde-91cc-617089223d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d019d5-44a0-4bde-91cc-617089223d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6ebdf1-d964-41f6-a13c-f8c45926c377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d6ebdf1-d964-41f6-a13c-f8c45926c377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3fb4e9a-f8fa-4b30-9cab-503e767d2f30', 'volume_name': 'volume-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a6b8bda-bbb5-4fca-bab0-74c6ed148051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a6b8bda-bbb5-4fca-bab0-74c6ed148051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc981ea6-c56c-430c-b933-e4c3163f17b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:43 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Volume a3fb4e9a-f8fa-4b30-9cab-503e767d2f30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30', 'volume_size': 1}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-917412712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3fb4e9a-f8fa-4b30-9cab-503e767d2f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ddf70e507643fabf90b7f4c029c737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:09:43Z,use_quota=True,user_id='4873f35bec6a44d5ab06f44e2e79db15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Creating volume a3fb4e9a-f8fa-4b30-9cab-503e767d2f30 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:09:43 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:09:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:44 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=26, name=volume-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:09:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30 1073741824" returned: 0 in 1.180s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30" returned: 0 in 0.207s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] <== create_volume: return (1620ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:09:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:09:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:09:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:09:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:09:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:09:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:09:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:09:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc981ea6-c56c-430c-b933-e4c3163f17b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8686a8-8ff7-4a17-8f35-bba91e9dcf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.669s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:09:47 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Volume volume-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30 (a3fb4e9a-f8fa-4b30-9cab-503e767d2f30): created successfully
Sep 18 22:09:47 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8686a8-8ff7-4a17-8f35-bba91e9dcf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:47 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Flow 'volume_create_manager' (0388b47a-e122-4d8f-9d53-acfbe31d2ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:09:47 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-21925a5d-3451-4b18-8929-00a80bbc5abd tempest-VolumesListAdminTestJSON-1609119818 None] Created volume successfully.
Sep 18 22:09:49 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Flow 'volume_create_manager' (0cf530a5-8621-49b2-ad40-98313c62154e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b426a10-126b-4cf8-ba23-6b90f8a424b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b426a10-126b-4cf8-ba23-6b90f8a424b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-249531092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf97cef-975c-4132-a026-5d5ddf569264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ddf70e507643fabf90b7f4c029c737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:09:49Z,use_quota=True,user_id='4873f35bec6a44d5ab06f44e2e79db15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5faa92-d1bd-4770-8db9-98c0d507c260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af5faa92-d1bd-4770-8db9-98c0d507c260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e386754f-00f2-4d32-9d3c-5ca2b08c5de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e386754f-00f2-4d32-9d3c-5ca2b08c5de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbf97cef-975c-4132-a026-5d5ddf569264', 'volume_name': 'volume-fbf97cef-975c-4132-a026-5d5ddf569264', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873be681-d11c-4e4d-a45f-1549dd17836a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873be681-d11c-4e4d-a45f-1549dd17836a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95645c2-f20f-4666-b165-2a24b88092dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:49 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Volume fbf97cef-975c-4132-a026-5d5ddf569264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbf97cef-975c-4132-a026-5d5ddf569264', 'volume_size': 1}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-249531092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf97cef-975c-4132-a026-5d5ddf569264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ddf70e507643fabf90b7f4c029c737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:09:49Z,use_quota=True,user_id='4873f35bec6a44d5ab06f44e2e79db15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Creating volume fbf97cef-975c-4132-a026-5d5ddf569264 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:09:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:09:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:09:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:09:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:09:50 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:09:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fbf97cef-975c-4132-a026-5d5ddf569264 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:50 devstack quobyte-client[83360]: System call of process 89188 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:09:50 devstack quobyte-client[83360]: System call of process 89188 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:09:50 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=27, name=volume-fbf97cef-975c-4132-a026-5d5ddf569264, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:09:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fbf97cef-975c-4132-a026-5d5ddf569264 1073741824" returned: 0 in 0.829s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fbf97cef-975c-4132-a026-5d5ddf569264 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fbf97cef-975c-4132-a026-5d5ddf569264" returned: 0 in 0.340s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:51 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] <== create_volume: return (1368ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:09:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:09:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95645c2-f20f-4666-b165-2a24b88092dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf97cef-975c-4132-a026-5d5ddf569264', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182742c7-42c4-49c6-a27c-68b64c2e22b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:52 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Volume volume-fbf97cef-975c-4132-a026-5d5ddf569264 (fbf97cef-975c-4132-a026-5d5ddf569264): created successfully
Sep 18 22:09:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182742c7-42c4-49c6-a27c-68b64c2e22b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Flow 'volume_create_manager' (0cf530a5-8621-49b2-ad40-98313c62154e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:09:52 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-87e8f7b4-59aa-42c2-9a52-4721601753e9 tempest-VolumesListAdminTestJSON-1609119818 None] Created volume successfully.
Sep 18 22:09:54 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Flow 'volume_create_manager' (30dca813-8e1e-4a33-a5b6-05528c31b8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9a0165-91ae-44c3-8460-77ff4ea0715e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9a0165-91ae-44c3-8460-77ff4ea0715e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1105266279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b03802-3d4e-4f9a-b48a-80405a944ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ddf70e507643fabf90b7f4c029c737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:09:55Z,use_quota=True,user_id='4873f35bec6a44d5ab06f44e2e79db15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3f88d9-b79a-4d09-88c6-8c8e12598d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3f88d9-b79a-4d09-88c6-8c8e12598d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81baa444-82c1-49ce-b225-f1c227a18011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81baa444-82c1-49ce-b225-f1c227a18011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19b03802-3d4e-4f9a-b48a-80405a944ac8', 'volume_name': 'volume-19b03802-3d4e-4f9a-b48a-80405a944ac8', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e39c8e-0886-41cd-9cd9-9087099d85ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e39c8e-0886-41cd-9cd9-9087099d85ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a2c177-c666-4a1a-bcd3-cc3aa2f08afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:54 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Volume 19b03802-3d4e-4f9a-b48a-80405a944ac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19b03802-3d4e-4f9a-b48a-80405a944ac8', 'volume_size': 1}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1105266279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19b03802-3d4e-4f9a-b48a-80405a944ac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ddf70e507643fabf90b7f4c029c737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:09:55Z,use_quota=True,user_id='4873f35bec6a44d5ab06f44e2e79db15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Creating volume 19b03802-3d4e-4f9a-b48a-80405a944ac8 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:09:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:09:55 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:09:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:09:55 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:09:55 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:09:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-19b03802-3d4e-4f9a-b48a-80405a944ac8 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:55 devstack quobyte-client[83360]: System call of process 89196 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:09:55 devstack quobyte-client[83360]: System call of process 89196 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:09:55 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=28, name=volume-19b03802-3d4e-4f9a-b48a-80405a944ac8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:09:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-19b03802-3d4e-4f9a-b48a-80405a944ac8 1073741824" returned: 0 in 0.899s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-19b03802-3d4e-4f9a-b48a-80405a944ac8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-19b03802-3d4e-4f9a-b48a-80405a944ac8" returned: 0 in 0.832s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] <== create_volume: return (2001ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:09:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:09:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a2c177-c666-4a1a-bcd3-cc3aa2f08afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19b03802-3d4e-4f9a-b48a-80405a944ac8', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2965006-e40d-4d5d-accc-92aaef723f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:57 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Volume volume-19b03802-3d4e-4f9a-b48a-80405a944ac8 (19b03802-3d4e-4f9a-b48a-80405a944ac8): created successfully
Sep 18 22:09:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2965006-e40d-4d5d-accc-92aaef723f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Flow 'volume_create_manager' (30dca813-8e1e-4a33-a5b6-05528c31b8d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:09:57 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-f6cf827b-fabc-4627-8bb6-20b4899e3fe0 tempest-VolumesListAdminTestJSON-1609119818 None] Created volume successfully.
Sep 18 22:09:58 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Flow 'volume_create_manager' (03fecb6e-9ff4-4e54-afc8-95b7104076b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ecf4fa-4ab7-411b-997c-3b459e029fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ecf4fa-4ab7-411b-997c-3b459e029fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57052aa5-894d-42d6-ae53-8050027813cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1291a4f8ab4fd4b51aecf5661fd69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:09:59Z,use_quota=True,user_id='81f7748bcc9d4658b504ac87e759d77b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28634da4-4e64-4051-8772-32b19866904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28634da4-4e64-4051-8772-32b19866904e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ea17ba-41fa-4ef6-a363-df852d021533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ea17ba-41fa-4ef6-a363-df852d021533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57052aa5-894d-42d6-ae53-8050027813cb', 'volume_name': 'volume-57052aa5-894d-42d6-ae53-8050027813cb', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdc8de7-3db7-42da-9261-bd48b97f2c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdc8de7-3db7-42da-9261-bd48b97f2c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0d0f7e-2ee9-43e1-9a9f-cde837d7271b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:59 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Volume 57052aa5-894d-42d6-ae53-8050027813cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57052aa5-894d-42d6-ae53-8050027813cb', 'volume_size': 1}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57052aa5-894d-42d6-ae53-8050027813cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1291a4f8ab4fd4b51aecf5661fd69e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:09:59Z,use_quota=True,user_id='81f7748bcc9d4658b504ac87e759d77b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Creating volume 57052aa5-894d-42d6-ae53-8050027813cb {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:09:59 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-57052aa5-894d-42d6-ae53-8050027813cb 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:59 devstack quobyte-client[83360]: System call of process 89235 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:09:59 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=29, name=volume-57052aa5-894d-42d6-ae53-8050027813cb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-57052aa5-894d-42d6-ae53-8050027813cb 1073741824" returned: 0 in 0.304s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-57052aa5-894d-42d6-ae53-8050027813cb {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-57052aa5-894d-42d6-ae53-8050027813cb" returned: 0 in 0.098s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] <== create_volume: return (475ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.487s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0d0f7e-2ee9-43e1-9a9f-cde837d7271b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57052aa5-894d-42d6-ae53-8050027813cb', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98662a14-a72a-4782-8e92-1ad39295eab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:09:59 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Volume volume-57052aa5-894d-42d6-ae53-8050027813cb (57052aa5-894d-42d6-ae53-8050027813cb): created successfully
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98662a14-a72a-4782-8e92-1ad39295eab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:09:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Flow 'volume_create_manager' (03fecb6e-9ff4-4e54-afc8-95b7104076b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:09:59 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-28b6305f-42a4-4171-ad6f-4d3e3e0e59e1 tempest-VolumesListAdminTestJSON-338244505 None] Created volume successfully.
Sep 18 22:10:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Acquiring lock "cinder-57052aa5-894d-42d6-ae53-8050027813cb-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Lock "cinder-57052aa5-894d-42d6-ae53-8050027813cb-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:01 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Acquiring lock "cinder-quobyte-57052aa5-894d-42d6-ae53-8050027813cb" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Lock "cinder-quobyte-57052aa5-894d-42d6-ae53-8050027813cb" acquired by "delete_volume" :: waited 0.014s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Acquiring lock "cinder-19b03802-3d4e-4f9a-b48a-80405a944ac8-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "cinder-19b03802-3d4e-4f9a-b48a-80405a944ac8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:01 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a066a1-b5d9-4e16-859a-e52d8e4fca4b]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:10:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-57052aa5-894d-42d6-ae53-8050027813cb {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:02 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:02 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Acquiring lock "cinder-quobyte-19b03802-3d4e-4f9a-b48a-80405a944ac8" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:02 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "cinder-quobyte-19b03802-3d4e-4f9a-b48a-80405a944ac8" acquired by "delete_volume" :: waited 0.063s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:02 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6f3daa-4023-4f6c-b030-4f1db57ee6b8]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:10:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-19b03802-3d4e-4f9a-b48a-80405a944ac8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:02 devstack quobyte-client[83360]: System call of process 89239 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:02 devstack quobyte-client[83360]: System call of process 89239 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:02 devstack quobyte-client[83360]: System call of process 89239 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-57052aa5-894d-42d6-ae53-8050027813cb" returned: 0 in 0.751s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-57052aa5-894d-42d6-ae53-8050027813cb {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-57052aa5-894d-42d6-ae53-8050027813cb" returned: 0 in 0.196s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:02 devstack quobyte-client[83360]: System call of process 89240 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:02 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Lock "cinder-quobyte-57052aa5-894d-42d6-ae53-8050027813cb" released by "delete_volume" :: held 1.274s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-19b03802-3d4e-4f9a-b48a-80405a944ac8" returned: 0 in 0.773s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-19b03802-3d4e-4f9a-b48a-80405a944ac8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-19b03802-3d4e-4f9a-b48a-80405a944ac8" returned: 0 in 0.281s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "cinder-quobyte-19b03802-3d4e-4f9a-b48a-80405a944ac8" released by "delete_volume" :: held 1.205s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:03 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Created reservations ['0704aca9-99e2-4378-86cc-2f32e96512d5', '514bbb15-f817-42ce-a72e-7e9271ab034d', '08a10695-4412-4cb1-97cc-0ffdd42a6c37', 'ecb52ba0-3160-4454-ae1d-e100ae28d58c'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:10:03 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Created reservations ['3a62164d-9478-4506-a398-47456c353751', '068630de-3a13-4e5c-9505-babe977fedc8', 'a10c3671-8564-4711-874d-811dbdaba8cb', '988eaf08-bf0c-4977-906f-d865e26f4141'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:10:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:03 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:10:03 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:10:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.354s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:10:04 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Deleted volume successfully.
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Acquiring lock "cinder-fbf97cef-975c-4132-a026-5d5ddf569264-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.329s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Lock "cinder-fbf97cef-975c-4132-a026-5d5ddf569264-delete_volume" acquired by "delete_volume" :: waited 0.215s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:04 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Deleted volume successfully.
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2392c242-b0d5-4596-96ac-5287593a43b9 tempest-VolumesListAdminTestJSON-338244505 None] Lock "cinder-57052aa5-894d-42d6-ae53-8050027813cb-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:04 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Acquiring lock "cinder-quobyte-fbf97cef-975c-4132-a026-5d5ddf569264" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a53d580d-3b2f-43cb-a276-d650da3f1f96 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "cinder-19b03802-3d4e-4f9a-b48a-80405a944ac8-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Lock "cinder-quobyte-fbf97cef-975c-4132-a026-5d5ddf569264" acquired by "delete_volume" :: waited 0.015s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[95161aa4-50c3-4649-9157-9741072a07c0]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:10:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fbf97cef-975c-4132-a026-5d5ddf569264 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:05 devstack quobyte-client[83360]: System call of process 89251 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:05 devstack quobyte-client[83360]: System call of process 89251 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:05 devstack quobyte-client[83360]: System call of process 89251 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fbf97cef-975c-4132-a026-5d5ddf569264" returned: 0 in 0.548s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fbf97cef-975c-4132-a026-5d5ddf569264 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fbf97cef-975c-4132-a026-5d5ddf569264" returned: 0 in 0.114s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Lock "cinder-quobyte-fbf97cef-975c-4132-a026-5d5ddf569264" released by "delete_volume" :: held 0.869s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:06 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Created reservations ['d9f48fc2-1a2d-4ec1-b7a2-5ea50ebda050', 'cd96bb3a-a34e-4c28-973f-b2e28ae6edb3', 'e258b2d6-dd16-478d-a6f8-ef46c49f20bc', '67fe35ba-9c70-49b1-84bc-96b587f8c517'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:10:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:10:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:10:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.168s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:06 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:10:06 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Deleted volume successfully.
Sep 18 22:10:07 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Acquiring lock "cinder-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:07 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-71de8e57-e5ed-4853-8bcb-f04ae24d230c tempest-VolumesListAdminTestJSON-1609119818 None] Lock "cinder-fbf97cef-975c-4132-a026-5d5ddf569264-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:07 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "cinder-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:07 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:07 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Acquiring lock "cinder-quobyte-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:07 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "cinder-quobyte-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30" acquired by "delete_volume" :: waited 0.021s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:07 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3732340e-7e67-4bd9-a675-70fcc4ae14b5]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:10:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30" returned: 0 in 0.634s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30" returned: 0 in 0.118s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "cinder-quobyte-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30" released by "delete_volume" :: held 0.966s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:08 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Created reservations ['158bb8e8-0654-4df4-8222-96f4f821bc64', '0121583c-dc36-400b-a0a5-a05eaf83581f', '059db713-52df-4a96-9cca-d951cd588d82', 'ff2b1e51-159c-4dde-9f31-d32c9da1d4c4'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:10:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:10:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:10:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.232s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:09 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:10:09 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Deleted volume successfully.
Sep 18 22:10:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d250147d-a72e-4e92-89ce-42520ef63d69 tempest-VolumesListAdminTestJSON-1609119818 None] Lock "cinder-a3fb4e9a-f8fa-4b30-9cab-503e767d2f30-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:18 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=45,cinder:DELETE=4,cinder:SELECT=24,cinder:INSERT=8 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:10:19 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=24,cinder:UPDATE=35,cinder:DELETE=4,cinder:INSERT=8 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:10:22 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Flow 'volume_create_manager' (ea7831d6-ced0-49b0-894e-4544241d92c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfef991-a1cd-4db5-9a08-ab3860efb43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bfef991-a1cd-4db5-9a08-ab3860efb43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-85611850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd100ea-a6df-4896-b686-f367e0745153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a0cc83180443cf872a5a27ca5ccb9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:10:22Z,use_quota=True,user_id='d50f234d23cf407cb424aace7cae7b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e213bd4-8f62-4ea6-afb5-3a72c8c68d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e213bd4-8f62-4ea6-afb5-3a72c8c68d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f2665d-bd77-4bf2-be70-cfec9504d15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04f2665d-bd77-4bf2-be70-cfec9504d15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd100ea-a6df-4896-b686-f367e0745153', 'volume_name': 'volume-0dd100ea-a6df-4896-b686-f367e0745153', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076ad600-9767-4d0e-bdb2-20e32df76de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (076ad600-9767-4d0e-bdb2-20e32df76de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b3f90c-ab51-40db-b949-f56dc2247848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:22 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Volume 0dd100ea-a6df-4896-b686-f367e0745153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd100ea-a6df-4896-b686-f367e0745153', 'volume_size': 1}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-85611850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd100ea-a6df-4896-b686-f367e0745153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41a0cc83180443cf872a5a27ca5ccb9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:10:22Z,use_quota=True,user_id='d50f234d23cf407cb424aace7cae7b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Creating volume 0dd100ea-a6df-4896-b686-f367e0745153 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:10:22 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:10:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0dd100ea-a6df-4896-b686-f367e0745153 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:23 devstack quobyte-client[83360]: System call of process 89318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:23 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=30, name=volume-0dd100ea-a6df-4896-b686-f367e0745153, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:10:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0dd100ea-a6df-4896-b686-f367e0745153 1073741824" returned: 0 in 0.700s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0dd100ea-a6df-4896-b686-f367e0745153 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0dd100ea-a6df-4896-b686-f367e0745153" returned: 0 in 0.177s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] <== create_volume: return (957ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:10:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b3f90c-ab51-40db-b949-f56dc2247848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd100ea-a6df-4896-b686-f367e0745153', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23b5999-2fc3-41ba-bb51-91dd8318d760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:24 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Volume volume-0dd100ea-a6df-4896-b686-f367e0745153 (0dd100ea-a6df-4896-b686-f367e0745153): created successfully
Sep 18 22:10:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23b5999-2fc3-41ba-bb51-91dd8318d760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Flow 'volume_create_manager' (ea7831d6-ced0-49b0-894e-4544241d92c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:10:24 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-58e0cc92-2485-46dd-8af3-f3008c21ea14 tempest-AbsoluteLimitsTests-78018853 None] Created volume successfully.
Sep 18 22:10:24 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Acquiring lock "cinder-0dd100ea-a6df-4896-b686-f367e0745153-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:24 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Lock "cinder-0dd100ea-a6df-4896-b686-f367e0745153-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:25 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Acquiring lock "cinder-quobyte-0dd100ea-a6df-4896-b686-f367e0745153" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Lock "cinder-quobyte-0dd100ea-a6df-4896-b686-f367e0745153" acquired by "delete_volume" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:25 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f6ff5c-3dac-4a3c-8ec1-60dfb7369009]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:10:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0dd100ea-a6df-4896-b686-f367e0745153 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0dd100ea-a6df-4896-b686-f367e0745153" returned: 0 in 0.427s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0dd100ea-a6df-4896-b686-f367e0745153 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0dd100ea-a6df-4896-b686-f367e0745153" returned: 0 in 0.110s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Lock "cinder-quobyte-0dd100ea-a6df-4896-b686-f367e0745153" released by "delete_volume" :: held 0.702s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:26 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Created reservations ['43d8f168-b198-4a96-852b-ee4ce712239d', '61e6933b-e704-4648-9e4c-9c4ba5bd7c58', '325f869f-97c4-42ec-9a0a-6eb80c0fe356', '85438462-c9cd-445d-86b2-efdf59df3c8f'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:10:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:10:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:10:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.099s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:26 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:10:26 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Deleted volume successfully.
Sep 18 22:10:26 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-edda7269-87e1-44d3-b6a3-11ed33acd11a tempest-AbsoluteLimitsTests-78018853 None] Lock "cinder-0dd100ea-a6df-4896-b686-f367e0745153-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:31 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Flow 'volume_create_manager' (df01ab46-a289-4eb1-a0d6-e38a1263a6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008bcba5-dcc3-4e5f-a5fe-adcdf72b6d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008bcba5-dcc3-4e5f-a5fe-adcdf72b6d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-476525784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab3b2d8-c48a-45bb-8705-d688fb89f0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc53cd3e02442bdb5ba57ea002c20c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:10:31Z,use_quota=True,user_id='c986eb19a79c4e1eb7f55de68355b51a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad78773-f56b-4e7e-88ba-ec1e6203ebb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad78773-f56b-4e7e-88ba-ec1e6203ebb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595da73d-de5d-4d26-ab53-f0dd832239fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595da73d-de5d-4d26-ab53-f0dd832239fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab3b2d8-c48a-45bb-8705-d688fb89f0b5', 'volume_name': 'volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e3d3fb-cbf2-4cc5-8be5-6feab648f6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e3d3fb-cbf2-4cc5-8be5-6feab648f6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7307af-0913-48bc-8f48-9c4aaccdf447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:31 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Volume 4ab3b2d8-c48a-45bb-8705-d688fb89f0b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5', 'volume_size': 1}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-476525784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab3b2d8-c48a-45bb-8705-d688fb89f0b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc53cd3e02442bdb5ba57ea002c20c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:10:31Z,use_quota=True,user_id='c986eb19a79c4e1eb7f55de68355b51a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Creating volume 4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:10:31 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:10:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:32 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=31, name=volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:10:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 1073741824" returned: 0 in 0.343s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5" returned: 0 in 0.085s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:32 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] <== create_volume: return (510ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:10:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.527s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac7307af-0913-48bc-8f48-9c4aaccdf447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf11a878-02eb-48af-826d-b16999a6d181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:32 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Volume volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 (4ab3b2d8-c48a-45bb-8705-d688fb89f0b5): created successfully
Sep 18 22:10:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf11a878-02eb-48af-826d-b16999a6d181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Flow 'volume_create_manager' (df01ab46-a289-4eb1-a0d6-e38a1263a6f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:10:32 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c3557900-5c76-4a2d-a961-e01c4bce5304 tempest-VolumesDeleteCascade-906291160 None] Created volume successfully.
Sep 18 22:10:33 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:34 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] Creating offline snapshot a389a371-5c04-4cc7-a218-e9855c76ca15 of volume 4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:10:34 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09fb642-dc88-4b8a-b337-1003470cf030]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:10:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5" returned: 0 in 0.383s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:34 devstack quobyte-client[83360]: System call of process 89345 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:34 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=32, name=volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:10:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 1G" returned: 0 in 0.249s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] CMD "qemu-img rebase -u -b volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15" returned: 0 in 0.149s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:34 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:10:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15" returned: 0 in 0.086s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:10:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15" returned: 0 in 0.101s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.info" returned: 0 in 0.085s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:10:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.info" returned: 0 in 0.077s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.460s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:35 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-7cf5e960-d6af-46f7-a4de-96337476e83d tempest-VolumesDeleteCascade-906291160 None] Create snapshot completed successfully
Sep 18 22:10:36 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] Creating offline snapshot 7d371b91-d658-468b-9dfa-399c014e1cf5 of volume 4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:10:36 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e05491-8a16-4810-a8c7-d801352780f8]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:10:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:36 devstack quobyte-client[83360]: System call of process 89355 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15" returned: 0 in 0.399s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:10:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:36 devstack quobyte-client[83360]: System call of process 89358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:37 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=34, name=volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:10:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5 1G" returned: 0 in 0.299s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] CMD "qemu-img rebase -u -b volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5" returned: 0 in 0.137s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:10:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5" returned: 0 in 0.086s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:10:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5" returned: 0 in 0.098s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.383s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:37 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-7b118dbb-27d6-4fd7-89a0-93cc238ff4a5 tempest-VolumesDeleteCascade-906291160 None] Create snapshot completed successfully
Sep 18 22:10:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:38 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Performing cascade delete. {{(pid=83342) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 18 22:10:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-7d371b91-d658-468b-9dfa-399c014e1cf5-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-7d371b91-d658-468b-9dfa-399c014e1cf5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:38 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-quobyte-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-quobyte-7d371b91-d658-468b-9dfa-399c014e1cf5" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-7d371b91-d658-468b-9dfa-399c014e1cf5" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Deleting offline snapshot 7d371b91-d658-468b-9dfa-399c014e1cf5 of volume 4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:10:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] snapshot_file for this snap is: volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:10:38 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc25a51f-5f51-46a7-a855-149d5ccbf9fd]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:10:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:39 devstack quobyte-client[83360]: System call of process 89367 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:39 devstack quobyte-client[83360]: System call of process 89367 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5" returned: 0 in 0.461s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:10:39 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0524e9a-645e-47ca-bd83-6dc005fdb83a]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:10:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:39 devstack quobyte-client[83360]: System call of process 89370 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15" returned: 0 in 0.477s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:10:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5" returned: 0 in 0.291s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.7d371b91-d658-468b-9dfa-399c014e1cf5" returned: 0 in 0.127s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-7d371b91-d658-468b-9dfa-399c014e1cf5" released by "_delete_snapshot" :: held 1.693s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5" released by "delete_snapshot" :: held 1.716s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:40 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Created reservations ['3e467c42-1f74-4640-8a0b-f7fb902b2802', '2916ab4c-d1e3-42cc-b07d-3b921d73c676', 'c472757d-ed2d-4702-a8f7-3bd06aad279c', 'e6098077-2736-4bb6-9fc0-5b13f6d14c6b'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:10:40 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Delete snapshot completed successfully.
Sep 18 22:10:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-7d371b91-d658-468b-9dfa-399c014e1cf5-delete_snapshot" released by "delete_snapshot" :: held 2.308s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-a389a371-5c04-4cc7-a218-e9855c76ca15-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-a389a371-5c04-4cc7-a218-e9855c76ca15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:40 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:41 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-quobyte-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:41 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:41 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-quobyte-a389a371-5c04-4cc7-a218-e9855c76ca15" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:41 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-a389a371-5c04-4cc7-a218-e9855c76ca15" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Deleting offline snapshot a389a371-5c04-4cc7-a218-e9855c76ca15 of volume 4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:10:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] snapshot_file for this snap is: volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:10:41 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[df483f98-0004-4129-8669-cb35ef8011b4]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:10:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15" returned: 0 in 0.535s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:10:41 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03fc8c0-a92f-45f8-b557-20933b43ebe3]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:10:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:42 devstack quobyte-client[83360]: System call of process 89388 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5" returned: 0 in 0.743s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:42 devstack quobyte-client[83360]: System call of process 89396 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15" returned: 0 in 0.287s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5.a389a371-5c04-4cc7-a218-e9855c76ca15" returned: 0 in 0.165s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:43 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-a389a371-5c04-4cc7-a218-e9855c76ca15" released by "_delete_snapshot" :: held 2.158s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:43 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5" released by "delete_snapshot" :: held 2.188s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:43 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Created reservations ['b980d64f-0c7d-47e5-b971-925ac9d1d231', 'fa156ab1-b0cc-4d24-aaa7-a0ddbcc8a400', '12fed627-0036-4629-b4b3-4045b2b09beb', '30895313-a653-4b29-b8eb-7fa2f329366e'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:10:43 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Delete snapshot completed successfully.
Sep 18 22:10:43 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-a389a371-5c04-4cc7-a218-e9855c76ca15-delete_snapshot" released by "delete_snapshot" :: held 2.749s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Snapshots deleted, issuing volume delete {{(pid=83342) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 18 22:10:43 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-quobyte-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:43 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5" acquired by "delete_volume" :: waited 0.030s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:43 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c255de-6712-4805-8dcd-31e7825e13a8]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:10:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:44 devstack quobyte-client[83360]: System call of process 89408 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5" returned: 0 in 0.889s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:45 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-d58b8e3a-0170-4880-b928-a41f8665bf16 req-5281bf98-551c-4067-ad98-8ae0be8d6c1d tempest-AttachVolumeShelveTestJSON-1275355314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5" returned: 0 in 0.548s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5" released by "delete_volume" :: held 1.698s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:45 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-d58b8e3a-0170-4880-b928-a41f8665bf16 req-5281bf98-551c-4067-ad98-8ae0be8d6c1d tempest-AttachVolumeShelveTestJSON-1275355314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:45 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-d58b8e3a-0170-4880-b928-a41f8665bf16 req-5281bf98-551c-4067-ad98-8ae0be8d6c1d tempest-AttachVolumeShelveTestJSON-1275355314 None] Terminate volume connection completed successfully.
Sep 18 22:10:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-d58b8e3a-0170-4880-b928-a41f8665bf16 req-5281bf98-551c-4067-ad98-8ae0be8d6c1d tempest-AttachVolumeShelveTestJSON-1275355314 None] Deleting attachment b0137c45-6996-4e1f-8f56-7e7bd256d340. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:10:45 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Created reservations ['1e106eea-0581-45c8-b667-35928da671b2', '722f75b1-1498-41f1-bba8-8908313cc26f', 'ca777a6b-1f12-430b-8ef1-c9eae2589bb1', '8dc834c3-2061-46e7-99a6-bb59847a59ea'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:10:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:10:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:10:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.334s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:46 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:10:46 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Deleted volume successfully.
Sep 18 22:10:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:10:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:10:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:10:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:47 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7949272f-631d-43de-9d1f-4272bc982e9f tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-4ab3b2d8-c48a-45bb-8705-d688fb89f0b5-delete_volume" released by "delete_volume" :: held 8.639s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:10:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.588s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:10:48 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Flow 'volume_create_manager' (ba5116d0-e489-4527-b190-a9305a74d4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5551e3a6-7732-43c8-966d-c74f157c1232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5551e3a6-7732-43c8-966d-c74f157c1232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1860302597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fcb5e8-c943-487d-bb53-353005bba5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc53cd3e02442bdb5ba57ea002c20c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:10:48Z,use_quota=True,user_id='c986eb19a79c4e1eb7f55de68355b51a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbcb779-b399-44cc-9d80-5ff390d0a7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbcb779-b399-44cc-9d80-5ff390d0a7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a46068-e6b1-404c-9540-ecd8d4dde58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2a46068-e6b1-404c-9540-ecd8d4dde58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1fcb5e8-c943-487d-bb53-353005bba5d5', 'volume_name': 'volume-d1fcb5e8-c943-487d-bb53-353005bba5d5', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939dc056-0995-4329-b998-219049774edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (939dc056-0995-4329-b998-219049774edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a604ed90-c982-4a1c-a2ba-271f6224c349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:48 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Volume d1fcb5e8-c943-487d-bb53-353005bba5d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1fcb5e8-c943-487d-bb53-353005bba5d5', 'volume_size': 1}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1860302597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fcb5e8-c943-487d-bb53-353005bba5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc53cd3e02442bdb5ba57ea002c20c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:10:48Z,use_quota=True,user_id='c986eb19a79c4e1eb7f55de68355b51a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Creating volume d1fcb5e8-c943-487d-bb53-353005bba5d5 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:10:48 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:10:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:48 devstack quobyte-client[83360]: System call of process 89441 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:48 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=35, name=volume-d1fcb5e8-c943-487d-bb53-353005bba5d5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:10:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 1073741824" returned: 0 in 0.485s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5" returned: 0 in 0.174s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] <== create_volume: return (842ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:10:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a604ed90-c982-4a1c-a2ba-271f6224c349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1fcb5e8-c943-487d-bb53-353005bba5d5', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cc94fb-fa52-4a82-94a1-95b65c814205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:51 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Volume volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 (d1fcb5e8-c943-487d-bb53-353005bba5d5): created successfully
Sep 18 22:10:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30cc94fb-fa52-4a82-94a1-95b65c814205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Flow 'volume_create_manager' (ba5116d0-e489-4527-b190-a9305a74d4bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:10:51 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-f7918823-4242-4e95-93e9-5ec20b350fb9 tempest-VolumesDeleteCascade-906291160 None] Created volume successfully.
Sep 18 22:10:52 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] Creating offline snapshot 626ec6cb-2063-4ade-9ff0-f9cdbf9439ae of volume d1fcb5e8-c943-487d-bb53-353005bba5d5 {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:10:52 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[263fa5ba-c5c3-48f3-8b1f-1875e33b3492]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:10:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:53 devstack quobyte-client[83360]: System call of process 89488 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:53 devstack quobyte-client[83360]: System call of process 89488 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:53 devstack quobyte-client[83360]: System call of process 89488 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:53 devstack quobyte-client[83360]: System call of process 89488 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5" returned: 0 in 1.113s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:53 devstack quobyte-client[83360]: System call of process 89493 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:53 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=36, name=volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:10:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae 1G" returned: 0 in 0.543s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:54 devstack quobyte-client[83360]: System call of process 89498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:54 devstack quobyte-client[83360]: System call of process 89498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:54 devstack quobyte-client[83360]: System call of process 89498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:54 devstack quobyte-client[83360]: System call of process 89498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] CMD "qemu-img rebase -u -b volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae" returned: 0 in 0.486s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:10:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae" returned: 0 in 0.164s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:10:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae" returned: 0 in 0.130s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.info" returned: 0 in 0.199s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:55 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:10:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.info" returned: 0 in 0.134s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.367s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:56 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-2a787be5-3d65-4bfe-964a-e242f76ea555 tempest-VolumesDeleteCascade-906291160 None] Create snapshot completed successfully
Sep 18 22:10:57 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Flow 'volume_create_manager' (f7faa568-67b9-415f-ad19-04e6c9366199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2425d01b-1107-478a-81e6-ba509e9063e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2425d01b-1107-478a-81e6-ba509e9063e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1963574234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=148e1fd3-92e1-4989-aaae-75bfae26d7ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fc53cd3e02442bdb5ba57ea002c20c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=626ec6cb-2063-4ade-9ff0-f9cdbf9439ae,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:10:57Z,use_quota=True,user_id='c986eb19a79c4e1eb7f55de68355b51a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4269a2ab-f061-4e4e-b3d0-a8030ff756a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4269a2ab-f061-4e4e-b3d0-a8030ff756a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e5b48a-b680-4aee-951a-c646e8448bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e5b48a-b680-4aee-951a-c646e8448bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '148e1fd3-92e1-4989-aaae-75bfae26d7ee', 'volume_name': 'volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee', 'volume_size': 1, 'snapshot_id': '626ec6cb-2063-4ade-9ff0-f9cdbf9439ae'}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cecc547-44a5-4486-9cc9-7765934284b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cecc547-44a5-4486-9cc9-7765934284b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7ab09f-1973-4216-96a1-0fdf85e72a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:10:57 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Volume 148e1fd3-92e1-4989-aaae-75bfae26d7ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee', 'volume_size': 1, 'snapshot_id': '626ec6cb-2063-4ade-9ff0-f9cdbf9439ae'}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-quobyte-626ec6cb-2063-4ade-9ff0-f9cdbf9439ae-148e1fd3-92e1-4989-aaae-75bfae26d7ee" by "_create_volume_from_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-626ec6cb-2063-4ade-9ff0-f9cdbf9439ae-148e1fd3-92e1-4989-aaae-75bfae26d7ee" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Creating volume 148e1fd3-92e1-4989-aaae-75bfae26d7ee from snapshot 626ec6cb-2063-4ade-9ff0-f9cdbf9439ae {{(pid=83342) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-quobyte-148e1fd3-92e1-4989-aaae-75bfae26d7ee" by "_copy_volume_from_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-148e1fd3-92e1-4989-aaae-75bfae26d7ee" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] snapshot: 626ec6cb-2063-4ade-9ff0-f9cdbf9439ae, volume: 148e1fd3-92e1-4989-aaae-75bfae26d7ee,  {{(pid=83342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d680f1-ce93-4db4-ab4a-205d4e26f2c2]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:10:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:10:59 devstack quobyte-client[83360]: System call of process 89517 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:59 devstack quobyte-client[83360]: System call of process 89517 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:59 devstack quobyte-client[83360]: System call of process 89517 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:10:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae" returned: 0 in 2.024s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:10:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1fcb5e8-c943-487d-bb53-353005bba5d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:10:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 {{(pid=83342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 22:10:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Creating direct copy from snapshot {{(pid=83342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 22:10:59 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e7fa8e-072e-47fe-ae33-630c4a7c3976]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:10:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:00 devstack quobyte-client[83360]: System call of process 89575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:11:00 devstack quobyte-client[83360]: System call of process 89575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:11:00 devstack quobyte-client[83360]: System call of process 89575 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:11:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5" returned: 0 in 0.727s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:00 devstack cinder-volume[83342]: DEBUG cinder.utils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee not found in is_blk_device check {{(pid=83342) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 22:11:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:00 devstack quobyte-client[83360]: System call of process 89582 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:11:00 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=38, name=volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:11:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee" returned: 0 in 6.398s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:07 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c32d712-5059-484c-8a2a-5db71cc8a456]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:11:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:07 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=32,cinder:UPDATE=39,cinder:DELETE=4,cinder:INSERT=5 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:11:07 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=34,cinder:SELECT=30,cinder:INSERT=11,cinder:DELETE=4 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:11:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5" returned: 0 in 0.915s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:08 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Image conversion details: src /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee {{(pid=83342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 22:11:08 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Converted 1024.00 MB image at 158.91 MB/s
Sep 18 22:11:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:11:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee" returned: 0 in 0.097s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-148e1fd3-92e1-4989-aaae-75bfae26d7ee" released by "_copy_volume_from_snapshot" :: held 10.729s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:11:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-626ec6cb-2063-4ade-9ff0-f9cdbf9439ae-148e1fd3-92e1-4989-aaae-75bfae26d7ee" released by "_create_volume_from_snapshot" :: held 10.796s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:11:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.820s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:11:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d7ab09f-1973-4216-96a1-0fdf85e72a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee', 'volume_size': 1, 'snapshot_id': '626ec6cb-2063-4ade-9ff0-f9cdbf9439ae'}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:11:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2da5e40-2eb0-4ecf-ac0d-eb92f6bea15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:11:08 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Volume volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee (148e1fd3-92e1-4989-aaae-75bfae26d7ee): created successfully
Sep 18 22:11:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2da5e40-2eb0-4ecf-ac0d-eb92f6bea15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:11:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Flow 'volume_create_manager' (f7faa568-67b9-415f-ad19-04e6c9366199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:11:08 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-da67d8a7-644b-466b-b91d-33335b13a428 tempest-VolumesDeleteCascade-906291160 None] Created volume successfully.
Sep 18 22:11:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-d1fcb5e8-c943-487d-bb53-353005bba5d5-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:11:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-d1fcb5e8-c943-487d-bb53-353005bba5d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:11:09 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:11:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Performing cascade delete. {{(pid=83342) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 18 22:11:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-626ec6cb-2063-4ade-9ff0-f9cdbf9439ae-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:11:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-626ec6cb-2063-4ade-9ff0-f9cdbf9439ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:11:09 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:11:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-quobyte-d1fcb5e8-c943-487d-bb53-353005bba5d5" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:11:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-d1fcb5e8-c943-487d-bb53-353005bba5d5" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:11:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-quobyte-626ec6cb-2063-4ade-9ff0-f9cdbf9439ae" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:11:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-626ec6cb-2063-4ade-9ff0-f9cdbf9439ae" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:11:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Deleting offline snapshot 626ec6cb-2063-4ade-9ff0-f9cdbf9439ae of volume d1fcb5e8-c943-487d-bb53-353005bba5d5 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:11:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] snapshot_file for this snap is: volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:11:09 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ef06c5-8c92-4ebe-91aa-00997411572d]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:11:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae" returned: 0 in 0.429s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1fcb5e8-c943-487d-bb53-353005bba5d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:11:10 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2aa173-7887-4276-bdd5-825bdbdb2149]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:11:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:10 devstack quobyte-client[83360]: System call of process 89617 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:11:10 devstack quobyte-client[83360]: System call of process 89617 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:11:10 devstack quobyte-client[83360]: System call of process 89617 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:11:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5" returned: 0 in 0.531s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae" returned: 0 in 0.262s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5.626ec6cb-2063-4ade-9ff0-f9cdbf9439ae" returned: 0 in 0.128s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-626ec6cb-2063-4ade-9ff0-f9cdbf9439ae" released by "_delete_snapshot" :: held 1.708s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:11:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-d1fcb5e8-c943-487d-bb53-353005bba5d5" released by "delete_snapshot" :: held 1.731s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:11:11 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Created reservations ['077c9dc7-8f18-4e1b-8333-24d5de6160a2', '02ffd1b6-0cf8-46c5-88c1-9196630bd094', '9f0c71fb-d9b0-4927-8663-126f809894be', '00e9f0cc-0179-4929-81d9-80c6b52ce543'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:11:11 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Delete snapshot completed successfully.
Sep 18 22:11:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-626ec6cb-2063-4ade-9ff0-f9cdbf9439ae-delete_snapshot" released by "delete_snapshot" :: held 2.506s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:11:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Snapshots deleted, issuing volume delete {{(pid=83342) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 18 22:11:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-quobyte-d1fcb5e8-c943-487d-bb53-353005bba5d5" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:11:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-d1fcb5e8-c943-487d-bb53-353005bba5d5" acquired by "delete_volume" :: waited 0.037s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:11:12 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d987c535-7a9b-4187-ad43-ef791ca75463]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:11:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5" returned: 0 in 0.489s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d1fcb5e8-c943-487d-bb53-353005bba5d5" returned: 0 in 0.167s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-d1fcb5e8-c943-487d-bb53-353005bba5d5" released by "delete_volume" :: held 0.996s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:11:13 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Created reservations ['e2c371f8-9086-4cb6-bf4d-3a9d2054adf3', 'c6dd917b-b563-48ed-97a2-a1fe884ce337', '949c5bc7-94c4-40f1-89f0-27effc20f1d4', '1bf041c9-3652-4160-95b9-cd7f17ad1b58'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:11:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:11:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:11:13 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:11:13 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:11:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:11:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.123s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:13 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:11:13 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Deleted volume successfully.
Sep 18 22:11:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-93d6836e-2062-4aa5-a232-6351bda1e7f7 tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-d1fcb5e8-c943-487d-bb53-353005bba5d5-delete_volume" released by "delete_volume" :: held 4.582s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:11:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-148e1fd3-92e1-4989-aaae-75bfae26d7ee-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:11:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-148e1fd3-92e1-4989-aaae-75bfae26d7ee-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:11:14 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:11:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "cinder-quobyte-148e1fd3-92e1-4989-aaae-75bfae26d7ee" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:11:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-148e1fd3-92e1-4989-aaae-75bfae26d7ee" acquired by "delete_volume" :: waited 0.028s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:11:14 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9874d2b-7d8c-470a-b5df-7fb955be00f3]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:11:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee" returned: 0 in 0.487s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-148e1fd3-92e1-4989-aaae-75bfae26d7ee" returned: 0 in 0.111s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-quobyte-148e1fd3-92e1-4989-aaae-75bfae26d7ee" released by "delete_volume" :: held 0.796s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:11:15 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Created reservations ['1e00f844-08aa-4047-a71e-a9565f31ceac', '79cc789a-559c-4fd3-a7cc-69a3e0cf69bc', '2a6ec8da-aa62-4450-9de7-532b946d10af', '73aad9fc-e737-4e03-b9b1-606090bfc9bd'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:11:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:11:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:11:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:11:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:11:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:11:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.079s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:15 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:11:15 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Deleted volume successfully.
Sep 18 22:11:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3c10739f-6fe1-4e18-a643-bba8e630d98b tempest-VolumesDeleteCascade-906291160 None] Lock "cinder-148e1fd3-92e1-4989-aaae-75bfae26d7ee-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:11:21 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Flow 'volume_create_manager' (3019ebd8-735c-436f-ab3a-92ef76577d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405cd8ce-b342-4fc5-86ac-b75e91df27cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405cd8ce-b342-4fc5-86ac-b75e91df27cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-256447208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70052b17-1c90-4b9e-bb06-45e06efbeb12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130868791eef440b87649cb4f2aa84c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:11:21Z,use_quota=True,user_id='ac34ce8d27f040e7bdfbd45eaabeea4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31ef569-43e2-4075-afef-fc0fc1b571bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31ef569-43e2-4075-afef-fc0fc1b571bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b5333b-05fd-4c3d-a3ae-e9de57733aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9b5333b-05fd-4c3d-a3ae-e9de57733aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70052b17-1c90-4b9e-bb06-45e06efbeb12', 'volume_name': 'volume-70052b17-1c90-4b9e-bb06-45e06efbeb12', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32149bf1-a4c7-44fb-88fb-644f7a92c4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32149bf1-a4c7-44fb-88fb-644f7a92c4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f542cf01-dabb-4502-bd59-9286f1352f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:11:21 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Volume 70052b17-1c90-4b9e-bb06-45e06efbeb12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70052b17-1c90-4b9e-bb06-45e06efbeb12', 'volume_size': 1}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-256447208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70052b17-1c90-4b9e-bb06-45e06efbeb12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130868791eef440b87649cb4f2aa84c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:11:21Z,use_quota=True,user_id='ac34ce8d27f040e7bdfbd45eaabeea4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Creating volume 70052b17-1c90-4b9e-bb06-45e06efbeb12 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:11:21 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:11:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-70052b17-1c90-4b9e-bb06-45e06efbeb12 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:22 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=39, name=volume-70052b17-1c90-4b9e-bb06-45e06efbeb12, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:11:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-70052b17-1c90-4b9e-bb06-45e06efbeb12 1073741824" returned: 0 in 0.413s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-70052b17-1c90-4b9e-bb06-45e06efbeb12 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-70052b17-1c90-4b9e-bb06-45e06efbeb12" returned: 0 in 0.142s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] <== create_volume: return (658ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:11:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:11:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f542cf01-dabb-4502-bd59-9286f1352f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70052b17-1c90-4b9e-bb06-45e06efbeb12', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:11:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caec6c93-2a38-4c24-9315-30754e0fe9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:11:22 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Volume volume-70052b17-1c90-4b9e-bb06-45e06efbeb12 (70052b17-1c90-4b9e-bb06-45e06efbeb12): created successfully
Sep 18 22:11:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caec6c93-2a38-4c24-9315-30754e0fe9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:11:22 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Flow 'volume_create_manager' (3019ebd8-735c-436f-ab3a-92ef76577d40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:11:22 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a2316327-86be-4854-81bb-a9845c959233 tempest-VolumesTransfersV355Test-2140296065 None] Created volume successfully.
Sep 18 22:11:24 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-7a79ba70-e9bc-4f0a-a418-879e444218e8 tempest-VolumesTransfersV355Test-1464896154 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:11:24 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-7a79ba70-e9bc-4f0a-a418-879e444218e8 tempest-VolumesTransfersV355Test-1464896154 None] Transfer volume completed successfully.
Sep 18 22:11:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Acquiring lock "cinder-70052b17-1c90-4b9e-bb06-45e06efbeb12-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:11:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Lock "cinder-70052b17-1c90-4b9e-bb06-45e06efbeb12-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:11:25 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:11:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Acquiring lock "cinder-quobyte-70052b17-1c90-4b9e-bb06-45e06efbeb12" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:11:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Lock "cinder-quobyte-70052b17-1c90-4b9e-bb06-45e06efbeb12" acquired by "delete_volume" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:11:25 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdd9e1f-8bd2-4823-923a-9e01fee78b60]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:11:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-70052b17-1c90-4b9e-bb06-45e06efbeb12 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-70052b17-1c90-4b9e-bb06-45e06efbeb12" returned: 0 in 0.411s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-70052b17-1c90-4b9e-bb06-45e06efbeb12 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-70052b17-1c90-4b9e-bb06-45e06efbeb12" returned: 0 in 0.192s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:26 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Lock "cinder-quobyte-70052b17-1c90-4b9e-bb06-45e06efbeb12" released by "delete_volume" :: held 0.788s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:11:26 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Created reservations ['7ae72b59-6abf-40e2-abb3-4ffa197502c9', '6862a3f7-22eb-4f3c-989e-844079589bd5', '74855903-a8f0-49d3-975a-0db5d55620b1', 'b550b107-8716-4b2d-b5d7-5455a1558bd0'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:11:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:11:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:11:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:11:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:11:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:11:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.159s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:27 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:11:27 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Deleted volume successfully.
Sep 18 22:11:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d30fcc68-0c72-4131-8dd7-2d9dd903e4e8 tempest-VolumesTransfersV355Test-829098381 None] Lock "cinder-70052b17-1c90-4b9e-bb06-45e06efbeb12-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:11:28 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Flow 'volume_create_manager' (a1a011cc-5710-44d0-811f-ae11065b51f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7c9de8-a370-4c78-9a42-10140247b491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7c9de8-a370-4c78-9a42-10140247b491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1427102394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f86c42e-f5f0-4f26-992a-d60e360a3942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130868791eef440b87649cb4f2aa84c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:11:28Z,use_quota=True,user_id='ac34ce8d27f040e7bdfbd45eaabeea4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82cf471b-9dd3-4878-99da-554c338f0557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82cf471b-9dd3-4878-99da-554c338f0557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e93b225-007e-4123-896b-4bb0e9bec01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e93b225-007e-4123-896b-4bb0e9bec01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f86c42e-f5f0-4f26-992a-d60e360a3942', 'volume_name': 'volume-7f86c42e-f5f0-4f26-992a-d60e360a3942', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f030d4-32ed-4951-9cf7-19d263a3ca0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f030d4-32ed-4951-9cf7-19d263a3ca0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7aca27-6321-4897-b372-19ad709dc61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:11:28 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Volume 7f86c42e-f5f0-4f26-992a-d60e360a3942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f86c42e-f5f0-4f26-992a-d60e360a3942', 'volume_size': 1}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1427102394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f86c42e-f5f0-4f26-992a-d60e360a3942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130868791eef440b87649cb4f2aa84c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:11:28Z,use_quota=True,user_id='ac34ce8d27f040e7bdfbd45eaabeea4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Creating volume 7f86c42e-f5f0-4f26-992a-d60e360a3942 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:11:28 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:11:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7f86c42e-f5f0-4f26-992a-d60e360a3942 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:28 devstack quobyte-client[83360]: System call of process 89691 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:11:28 devstack quobyte-client[83360]: System call of process 89691 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:11:29 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=40, name=volume-7f86c42e-f5f0-4f26-992a-d60e360a3942, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:11:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7f86c42e-f5f0-4f26-992a-d60e360a3942 1073741824" returned: 0 in 0.973s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7f86c42e-f5f0-4f26-992a-d60e360a3942 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7f86c42e-f5f0-4f26-992a-d60e360a3942" returned: 0 in 0.297s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:30 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] <== create_volume: return (1605ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:11:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:11:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7aca27-6321-4897-b372-19ad709dc61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f86c42e-f5f0-4f26-992a-d60e360a3942', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:11:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52f8d5e-e3bc-4d39-99d4-d17889250c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:11:30 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Volume volume-7f86c42e-f5f0-4f26-992a-d60e360a3942 (7f86c42e-f5f0-4f26-992a-d60e360a3942): created successfully
Sep 18 22:11:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b52f8d5e-e3bc-4d39-99d4-d17889250c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:11:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Flow 'volume_create_manager' (a1a011cc-5710-44d0-811f-ae11065b51f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:11:30 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-4d4eba19-913d-4bc7-98c1-b7adbff9d33f tempest-VolumesTransfersV355Test-2140296065 None] Created volume successfully.
Sep 18 22:11:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Acquiring lock "cinder-7f86c42e-f5f0-4f26-992a-d60e360a3942-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:11:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Lock "cinder-7f86c42e-f5f0-4f26-992a-d60e360a3942-delete_volume" acquired by "delete_volume" :: waited 0.169s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:11:32 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:11:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Acquiring lock "cinder-quobyte-7f86c42e-f5f0-4f26-992a-d60e360a3942" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:11:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Lock "cinder-quobyte-7f86c42e-f5f0-4f26-992a-d60e360a3942" acquired by "delete_volume" :: waited 0.016s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:11:32 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee81995c-3852-4b90-b854-a3e91ceaf263]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:11:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7f86c42e-f5f0-4f26-992a-d60e360a3942 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7f86c42e-f5f0-4f26-992a-d60e360a3942" returned: 0 in 0.434s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7f86c42e-f5f0-4f26-992a-d60e360a3942 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7f86c42e-f5f0-4f26-992a-d60e360a3942" returned: 0 in 0.090s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Lock "cinder-quobyte-7f86c42e-f5f0-4f26-992a-d60e360a3942" released by "delete_volume" :: held 0.704s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:11:33 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Created reservations ['4c601bba-b2c4-4d3b-8b45-5e3b0c5860bb', '2f7b02aa-4905-43b8-8c34-70f4d27f7e36', 'aa9e2b10-216f-4bd9-a583-a64128520eff', '2a39b34b-2329-4a61-bb91-b4490194fb47'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:11:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:11:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:11:33 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:11:33 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:11:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:11:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.112s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:34 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:11:34 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Deleted volume successfully.
Sep 18 22:11:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-31a119d1-cef2-4917-b32a-20acbb078536 tempest-VolumesTransfersV355Test-829098381 None] Lock "cinder-7f86c42e-f5f0-4f26-992a-d60e360a3942-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:11:35 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-d864ebdb-4623-45bf-84dd-462d46ae1f54 req-27c6060a-e3e4-49d5-870c-7e8b8d41fcad tempest-AttachVolumeNegativeTest-1277586577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:11:35 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-d864ebdb-4623-45bf-84dd-462d46ae1f54 req-27c6060a-e3e4-49d5-870c-7e8b8d41fcad tempest-AttachVolumeNegativeTest-1277586577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:11:35 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-d864ebdb-4623-45bf-84dd-462d46ae1f54 req-27c6060a-e3e4-49d5-870c-7e8b8d41fcad tempest-AttachVolumeNegativeTest-1277586577 None] Terminate volume connection completed successfully.
Sep 18 22:11:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-d864ebdb-4623-45bf-84dd-462d46ae1f54 req-27c6060a-e3e4-49d5-870c-7e8b8d41fcad tempest-AttachVolumeNegativeTest-1277586577 None] Deleting attachment 4eef307d-385c-490a-b879-20c6ccb7bb8a. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:11:45 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=26,cinder:UPDATE=40,cinder:DELETE=5,cinder:INSERT=11 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:11:45 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=47,cinder:SELECT=34,cinder:INSERT=9,cinder:DELETE=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:11:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:11:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:11:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.036s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:11:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:11:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:11:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.071s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:11:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:11:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.461s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:11:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:12:06 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Flow 'volume_create_manager' (0f134685-d16e-4d0f-9c80-df3ca50b720e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9624bf5d-f3c9-41a6-9c59-8f4b795df7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9624bf5d-f3c9-41a6-9c59-8f4b795df7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-537395584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec790bc-1103-424e-914e-76fe9fa4197f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df66c096aecd4808a465e9ad7c44e771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:12:06Z,use_quota=True,user_id='fe7bc9ded87444b180d79c79085681f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7201a1-95a5-4aa3-acff-63f9bb78a401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7201a1-95a5-4aa3-acff-63f9bb78a401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2dcf02-a8bb-4d98-a2fe-14618008c1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2dcf02-a8bb-4d98-a2fe-14618008c1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fec790bc-1103-424e-914e-76fe9fa4197f', 'volume_name': 'volume-fec790bc-1103-424e-914e-76fe9fa4197f', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14002696-9cbd-4a36-9608-cc25508e8239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14002696-9cbd-4a36-9608-cc25508e8239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ee67f2-91fd-45ba-8fd3-0e69fcfc4777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:12:06 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Volume fec790bc-1103-424e-914e-76fe9fa4197f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fec790bc-1103-424e-914e-76fe9fa4197f', 'volume_size': 1}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-537395584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fec790bc-1103-424e-914e-76fe9fa4197f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df66c096aecd4808a465e9ad7c44e771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:12:06Z,use_quota=True,user_id='fe7bc9ded87444b180d79c79085681f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Creating volume fec790bc-1103-424e-914e-76fe9fa4197f {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:12:06 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:12:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:12:06 devstack quobyte-client[83360]: System call of process 89925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:12:06 devstack quobyte-client[83360]: System call of process 89925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:12:06 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=41, name=volume-fec790bc-1103-424e-914e-76fe9fa4197f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:12:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f 1073741824" returned: 0 in 0.368s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:12:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:12:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f" returned: 0 in 0.133s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:12:07 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] <== create_volume: return (609ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:12:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.622s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:12:07 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ee67f2-91fd-45ba-8fd3-0e69fcfc4777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fec790bc-1103-424e-914e-76fe9fa4197f', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:12:07 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d8ea5e-f95d-4818-acff-f343f2b94307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:12:07 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Volume volume-fec790bc-1103-424e-914e-76fe9fa4197f (fec790bc-1103-424e-914e-76fe9fa4197f): created successfully
Sep 18 22:12:07 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d8ea5e-f95d-4818-acff-f343f2b94307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:12:07 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Flow 'volume_create_manager' (0f134685-d16e-4d0f-9c80-df3ca50b720e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:12:07 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-975c1231-d1c2-43ae-9bf2-81fbbe46a83c tempest-VolumesActionsTest-1930858958 None] Created volume successfully.
Sep 18 22:12:17 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:12:17 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:12:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1c9c0830-bb9f-4771-bd80-429fcb78a5a9 tempest-VolumesActionsTest-1930858958 None] Acquiring lock "cinder-fec790bc-1103-424e-914e-76fe9fa4197f" by "attach_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:12:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1c9c0830-bb9f-4771-bd80-429fcb78a5a9 tempest-VolumesActionsTest-1930858958 None] Lock "cinder-fec790bc-1103-424e-914e-76fe9fa4197f" acquired by "attach_volume" :: waited 0.059s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:12:39 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-1c9c0830-bb9f-4771-bd80-429fcb78a5a9 tempest-VolumesActionsTest-1930858958 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:12:39 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-1c9c0830-bb9f-4771-bd80-429fcb78a5a9 tempest-VolumesActionsTest-1930858958 None] Attaching volume fec790bc-1103-424e-914e-76fe9fa4197f to instance 06f8abad-4948-41ea-8a34-6499504728cc at mountpoint /dev/vdb on host None.
Sep 18 22:12:39 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-1c9c0830-bb9f-4771-bd80-429fcb78a5a9 tempest-VolumesActionsTest-1930858958 None] Attach volume completed successfully.
Sep 18 22:12:39 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1c9c0830-bb9f-4771-bd80-429fcb78a5a9 tempest-VolumesActionsTest-1930858958 None] Lock "cinder-fec790bc-1103-424e-914e-76fe9fa4197f" released by "attach_volume" :: held 0.479s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:12:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ea4c7f90-f0ef-4e8e-914f-afed9a1281f2 tempest-VolumesActionsTest-1930858958 None] Acquiring lock "cinder-fec790bc-1103-424e-914e-76fe9fa4197f-detach_volume" by "detach_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:12:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ea4c7f90-f0ef-4e8e-914f-afed9a1281f2 tempest-VolumesActionsTest-1930858958 None] Lock "cinder-fec790bc-1103-424e-914e-76fe9fa4197f-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:12:40 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-ea4c7f90-f0ef-4e8e-914f-afed9a1281f2 tempest-VolumesActionsTest-1930858958 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:12:40 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-ea4c7f90-f0ef-4e8e-914f-afed9a1281f2 tempest-VolumesActionsTest-1930858958 None] Detaching volume fec790bc-1103-424e-914e-76fe9fa4197f from instance 06f8abad-4948-41ea-8a34-6499504728cc.
Sep 18 22:12:40 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-ea4c7f90-f0ef-4e8e-914f-afed9a1281f2 tempest-VolumesActionsTest-1930858958 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:12:40 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-ea4c7f90-f0ef-4e8e-914f-afed9a1281f2 tempest-VolumesActionsTest-1930858958 None] Detach volume completed successfully.
Sep 18 22:12:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ea4c7f90-f0ef-4e8e-914f-afed9a1281f2 tempest-VolumesActionsTest-1930858958 None] Lock "cinder-fec790bc-1103-424e-914e-76fe9fa4197f-detach_volume" released by "detach_volume" :: held 0.249s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:12:40 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:12:40 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:12:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Flow 'volume_create_manager' (a626cbe6-a874-419e-a9a8-32c3509ad654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:12:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa5d573-cf09-445b-a7f3-0dd1d771e0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa5d573-cf09-445b-a7f3-0dd1d771e0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-505328405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2fb73a-a237-4fdc-a858-a9443a978df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b2d6252c0c4ca7bc89d364c28e4fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:12:41Z,use_quota=True,user_id='179a0bb1c78b4c80afdcf9a44ee32ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d679323a-658e-4229-be4c-a60444d3b152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d679323a-658e-4229-be4c-a60444d3b152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e3c05e-3962-4401-8032-ddcccffa0b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e3c05e-3962-4401-8032-ddcccffa0b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca2fb73a-a237-4fdc-a858-a9443a978df6', 'volume_name': 'volume-ca2fb73a-a237-4fdc-a858-a9443a978df6', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae98eaa9-0a4f-43f2-b188-32b70b2961f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae98eaa9-0a4f-43f2-b188-32b70b2961f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e56ef7f-da2c-47ef-a9ed-df045d7d386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:12:41 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Volume ca2fb73a-a237-4fdc-a858-a9443a978df6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca2fb73a-a237-4fdc-a858-a9443a978df6', 'volume_size': 1}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-505328405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca2fb73a-a237-4fdc-a858-a9443a978df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23b2d6252c0c4ca7bc89d364c28e4fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:12:41Z,use_quota=True,user_id='179a0bb1c78b4c80afdcf9a44ee32ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Creating volume ca2fb73a-a237-4fdc-a858-a9443a978df6 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.079s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:12:41 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:12:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ca2fb73a-a237-4fdc-a858-a9443a978df6 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:12:41 devstack quobyte-client[83360]: System call of process 90166 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:12:41 devstack quobyte-client[83360]: System call of process 90166 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:12:41 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=42, name=volume-ca2fb73a-a237-4fdc-a858-a9443a978df6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:12:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ca2fb73a-a237-4fdc-a858-a9443a978df6 1073741824" returned: 0 in 1.742s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:12:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ca2fb73a-a237-4fdc-a858-a9443a978df6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:12:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ca2fb73a-a237-4fdc-a858-a9443a978df6" returned: 0 in 0.328s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:12:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] <== create_volume: return (2467ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:12:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.495s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:12:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e56ef7f-da2c-47ef-a9ed-df045d7d386b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca2fb73a-a237-4fdc-a858-a9443a978df6', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:12:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e071387b-8dc9-42e7-b198-18a933ea92d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:12:46 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Volume volume-ca2fb73a-a237-4fdc-a858-a9443a978df6 (ca2fb73a-a237-4fdc-a858-a9443a978df6): created successfully
Sep 18 22:12:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e071387b-8dc9-42e7-b198-18a933ea92d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:12:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Flow 'volume_create_manager' (a626cbe6-a874-419e-a9a8-32c3509ad654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:12:46 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-8b3a4757-76f9-4b5e-926f-31f20c41ac41 tempest-AttachVolumeShelveTestJSON-1275355314 None] Created volume successfully.
Sep 18 22:12:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:12:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:12:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:12:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:12:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:12:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:12:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:12:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.525s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:12:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:12:56 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:12:56 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:13:14 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-2399f316-30a7-4b54-aa28-fa7e8baefc23 req-ed36e9d8-e0e7-43a1-b52e-36cf0dc5a5ea tempest-AttachVolumeShelveTestJSON-1275355314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:13:14 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-2399f316-30a7-4b54-aa28-fa7e8baefc23 req-ed36e9d8-e0e7-43a1-b52e-36cf0dc5a5ea tempest-AttachVolumeShelveTestJSON-1275355314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:13:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-2399f316-30a7-4b54-aa28-fa7e8baefc23 req-ed36e9d8-e0e7-43a1-b52e-36cf0dc5a5ea tempest-AttachVolumeShelveTestJSON-1275355314 None] No connector for attachment e59f3027-7675-4000-bc4a-c844655aae79; skipping storage backend terminate_connection call. {{(pid=83342) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 18 22:13:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-2399f316-30a7-4b54-aa28-fa7e8baefc23 req-ed36e9d8-e0e7-43a1-b52e-36cf0dc5a5ea tempest-AttachVolumeShelveTestJSON-1275355314 None] Deleting attachment e59f3027-7675-4000-bc4a-c844655aae79. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:13:24 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:13:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0f657fc9-f5f8-4ed0-800c-821585b28092 tempest-VolumesActionsTest-1930858958 None] Acquiring lock "cinder-fec790bc-1103-424e-914e-76fe9fa4197f" by "attach_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:13:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0f657fc9-f5f8-4ed0-800c-821585b28092 tempest-VolumesActionsTest-1930858958 None] Lock "cinder-fec790bc-1103-424e-914e-76fe9fa4197f" acquired by "attach_volume" :: waited 0.039s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:13:33 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-0f657fc9-f5f8-4ed0-800c-821585b28092 tempest-VolumesActionsTest-1930858958 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:13:33 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-0f657fc9-f5f8-4ed0-800c-821585b28092 tempest-VolumesActionsTest-1930858958 None] Attaching volume fec790bc-1103-424e-914e-76fe9fa4197f to instance 2515afba-442e-49a1-8bbf-2ee3cc7b7176 at mountpoint /dev/vdb on host None.
Sep 18 22:13:33 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-0f657fc9-f5f8-4ed0-800c-821585b28092 tempest-VolumesActionsTest-1930858958 None] Attach volume completed successfully.
Sep 18 22:13:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0f657fc9-f5f8-4ed0-800c-821585b28092 tempest-VolumesActionsTest-1930858958 None] Lock "cinder-fec790bc-1103-424e-914e-76fe9fa4197f" released by "attach_volume" :: held 0.360s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:13:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e0cebcff-c1d1-4835-9a92-d5a33cc52bd8 tempest-VolumesActionsTest-1930858958 None] Acquiring lock "cinder-fec790bc-1103-424e-914e-76fe9fa4197f-detach_volume" by "detach_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:13:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e0cebcff-c1d1-4835-9a92-d5a33cc52bd8 tempest-VolumesActionsTest-1930858958 None] Lock "cinder-fec790bc-1103-424e-914e-76fe9fa4197f-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:13:33 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e0cebcff-c1d1-4835-9a92-d5a33cc52bd8 tempest-VolumesActionsTest-1930858958 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:13:33 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e0cebcff-c1d1-4835-9a92-d5a33cc52bd8 tempest-VolumesActionsTest-1930858958 None] Detaching volume fec790bc-1103-424e-914e-76fe9fa4197f from instance 2515afba-442e-49a1-8bbf-2ee3cc7b7176.
Sep 18 22:13:33 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e0cebcff-c1d1-4835-9a92-d5a33cc52bd8 tempest-VolumesActionsTest-1930858958 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:13:33 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e0cebcff-c1d1-4835-9a92-d5a33cc52bd8 tempest-VolumesActionsTest-1930858958 None] Detach volume completed successfully.
Sep 18 22:13:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e0cebcff-c1d1-4835-9a92-d5a33cc52bd8 tempest-VolumesActionsTest-1930858958 None] Lock "cinder-fec790bc-1103-424e-914e-76fe9fa4197f-detach_volume" released by "detach_volume" :: held 0.208s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:13:43 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=4 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:13:43 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=3,cinder:SELECT=8 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:13:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:13:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:13:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:13:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:13:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:13:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:13:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:13:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.399s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:13:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:13:49 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:13:49 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:13:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Flow 'volume_create_manager' (ddbf9924-ef38-4768-ae26-45a262ae2e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:13:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3420c74d-28df-44a3-8d06-c5f9599fce87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3420c74d-28df-44a3-8d06-c5f9599fce87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-69071455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7509241-62ff-4ac7-abf6-970a60e669d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0bf6a603d834826bcdcdca9ab8a6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:13:48Z,use_quota=True,user_id='0c30399c19374fd6bdfc764ff35b042f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d50a69-b8e3-4f18-9933-147e68882ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d50a69-b8e3-4f18-9933-147e68882ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da36da2-03f1-4ba7-8241-10fa140a7b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da36da2-03f1-4ba7-8241-10fa140a7b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7509241-62ff-4ac7-abf6-970a60e669d3', 'volume_name': 'volume-e7509241-62ff-4ac7-abf6-970a60e669d3', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d153b681-5618-4677-9818-c2ea8f340121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d153b681-5618-4677-9818-c2ea8f340121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98301a83-d2d8-4338-b590-de6dc0550175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:13:50 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Volume e7509241-62ff-4ac7-abf6-970a60e669d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7509241-62ff-4ac7-abf6-970a60e669d3', 'volume_size': 1}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-69071455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7509241-62ff-4ac7-abf6-970a60e669d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0bf6a603d834826bcdcdca9ab8a6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:13:48Z,use_quota=True,user_id='0c30399c19374fd6bdfc764ff35b042f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Creating volume e7509241-62ff-4ac7-abf6-970a60e669d3 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.079s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:13:50 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:13:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e7509241-62ff-4ac7-abf6-970a60e669d3 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:13:50 devstack quobyte-client[83360]: System call of process 90608 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:13:50 devstack quobyte-client[83360]: System call of process 90608 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:13:51 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=43, name=volume-e7509241-62ff-4ac7-abf6-970a60e669d3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:13:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e7509241-62ff-4ac7-abf6-970a60e669d3 1073741824" returned: 0 in 1.932s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:13:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e7509241-62ff-4ac7-abf6-970a60e669d3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:13:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e7509241-62ff-4ac7-abf6-970a60e669d3" returned: 0 in 0.415s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:13:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] <== create_volume: return (2606ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:13:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.715s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:13:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98301a83-d2d8-4338-b590-de6dc0550175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7509241-62ff-4ac7-abf6-970a60e669d3', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:13:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767b549a-d5a6-407b-bd5d-02af3071e17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:13:53 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Volume volume-e7509241-62ff-4ac7-abf6-970a60e669d3 (e7509241-62ff-4ac7-abf6-970a60e669d3): created successfully
Sep 18 22:13:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767b549a-d5a6-407b-bd5d-02af3071e17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:13:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Flow 'volume_create_manager' (ddbf9924-ef38-4768-ae26-45a262ae2e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:13:53 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-4247c5c8-f3a5-4f4f-b018-0072cf01f3e3 tempest-AttachVolumeNegativeTest-1277586577 None] Created volume successfully.
Sep 18 22:13:53 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:13:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:13:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:13:53 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b79105a-bbb8-4cf3-9f57-91ef247849a4]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:13:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:13:54 devstack quobyte-client[83360]: System call of process 90630 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:13:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f" returned: 0 in 0.712s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:13:54 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[43550481-992d-43d1-98c5-a0c7d0896eea]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:13:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:13:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f" returned: 0 in 0.665s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:13:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f /opt/stack/data/cinder/conversion/fec790bc-1103-424e-914e-76fe9fa4197f.temp_image.966d8fde-c5d7-46d7-a306-abbf5f3bcdaaosnjzz8i.img {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:14:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f /opt/stack/data/cinder/conversion/fec790bc-1103-424e-914e-76fe9fa4197f.temp_image.966d8fde-c5d7-46d7-a306-abbf5f3bcdaaosnjzz8i.img" returned: 0 in 7.385s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:14:02 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c2cf2f-0b56-4f39-862c-8e8a022d9561]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:14:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:14:03 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:14:03 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:14:04 devstack quobyte-client[83360]: System call of process 90689 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:14:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-4159d748-6880-4dce-a1c7-1e891b464182 req-e4eb758c-3e44-4e2c-a2bd-bf4efcc3769a tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:14:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f" returned: 0 in 1.669s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:14:04 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] Image conversion details: src /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f, size 1024.00 MB, duration 7.51 sec, destination /opt/stack/data/cinder/conversion/fec790bc-1103-424e-914e-76fe9fa4197f.temp_image.966d8fde-c5d7-46d7-a306-abbf5f3bcdaaosnjzz8i.img {{(pid=83342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 22:14:04 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] Converted 1024.00 MB image at 136.36 MB/s
Sep 18 22:14:04 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] 966d8fde-c5d7-46d7-a306-abbf5f3bcdaa was raw, no need to convert to raw {{(pid=83342) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 18 22:14:14 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=4 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:14:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 44.444s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:14:37 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] Uploaded volume to glance image-id: 966d8fde-c5d7-46d7-a306-abbf5f3bcdaa. {{(pid=83342) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 18 22:14:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-4159d748-6880-4dce-a1c7-1e891b464182 req-e4eb758c-3e44-4e2c-a2bd-bf4efcc3769a tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 33.677s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:14:38 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f46130-5927-4ff0-9ef4-ace2ef4e96e5]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:14:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-4159d748-6880-4dce-a1c7-1e891b464182 req-e4eb758c-3e44-4e2c-a2bd-bf4efcc3769a tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e7509241-62ff-4ac7-abf6-970a60e669d3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:14:38 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-0656f42e-d399-4d7c-9752-62ff06274043 tempest-VolumesActionsTest-1930858958 None] Copy volume to image completed successfully.
Sep 18 22:14:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-4159d748-6880-4dce-a1c7-1e891b464182 req-e4eb758c-3e44-4e2c-a2bd-bf4efcc3769a tempest-AttachVolumeNegativeTest-1277586577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e7509241-62ff-4ac7-abf6-970a60e669d3" returned: 0 in 0.455s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:14:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-4159d748-6880-4dce-a1c7-1e891b464182 req-e4eb758c-3e44-4e2c-a2bd-bf4efcc3769a tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.523s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:14:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-4159d748-6880-4dce-a1c7-1e891b464182 req-e4eb758c-3e44-4e2c-a2bd-bf4efcc3769a tempest-AttachVolumeNegativeTest-1277586577 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-e7509241-62ff-4ac7-abf6-970a60e669d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5c38855-d8c7-476b-bf8b-8055160ba986', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:14:38 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-4159d748-6880-4dce-a1c7-1e891b464182 req-e4eb758c-3e44-4e2c-a2bd-bf4efcc3769a tempest-AttachVolumeNegativeTest-1277586577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:14:38 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-4159d748-6880-4dce-a1c7-1e891b464182 req-e4eb758c-3e44-4e2c-a2bd-bf4efcc3769a tempest-AttachVolumeNegativeTest-1277586577 None] attachment_update completed successfully.
Sep 18 22:14:39 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:14:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:14:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:14:39 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ca6ef3-028c-4ecb-b66f-ca37725db5b9]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:14:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:14:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f" returned: 0 in 0.441s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:14:40 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a84eeb0-4b20-4fa1-933c-28677e2b36ca]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:14:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:14:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f" returned: 0 in 0.545s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:14:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f /opt/stack/data/cinder/conversion/fec790bc-1103-424e-914e-76fe9fa4197f.temp_image.93ab86e4-9cdf-4cd0-8dcd-978ab576e452mmksk_x9.img {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:14:40 devstack quobyte-client[83360]: System call of process 91131 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:14:40 devstack quobyte-client[83360]: System call of process 91131 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:14:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:14:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:14:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:14:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:14:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:14:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.119s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:14:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:14:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.475s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:14:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:14:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f /opt/stack/data/cinder/conversion/fec790bc-1103-424e-914e-76fe9fa4197f.temp_image.93ab86e4-9cdf-4cd0-8dcd-978ab576e452mmksk_x9.img" returned: 0 in 7.206s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:14:48 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a79e417-b64a-4e4d-9e09-3747c4b231a5]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:14:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:14:48 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=4,cinder:SELECT=5 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:14:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f" returned: 0 in 1.125s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:14:49 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Image conversion details: src /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f, size 1024.00 MB, duration 7.24 sec, destination /opt/stack/data/cinder/conversion/fec790bc-1103-424e-914e-76fe9fa4197f.temp_image.93ab86e4-9cdf-4cd0-8dcd-978ab576e452mmksk_x9.img {{(pid=83342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 22:14:49 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Converted 1024.00 MB image at 141.50 MB/s
Sep 18 22:14:49 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] 93ab86e4-9cdf-4cd0-8dcd-978ab576e452 was raw, converting to qcow2 {{(pid=83342) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 18 22:14:49 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[687211ed-9084-4ebe-9cc1-efba7bbf7ae9]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:14:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fec790bc-1103-424e-914e-76fe9fa4197f.temp_image.93ab86e4-9cdf-4cd0-8dcd-978ab576e452mmksk_x9.img {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:14:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fec790bc-1103-424e-914e-76fe9fa4197f.temp_image.93ab86e4-9cdf-4cd0-8dcd-978ab576e452mmksk_x9.img" returned: 0 in 0.780s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:14:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fec790bc-1103-424e-914e-76fe9fa4197f.temp_image.93ab86e4-9cdf-4cd0-8dcd-978ab576e452mmksk_x9.img {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:14:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fec790bc-1103-424e-914e-76fe9fa4197f.temp_image.93ab86e4-9cdf-4cd0-8dcd-978ab576e452mmksk_x9.img" returned: 1 in 0.636s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:14:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fec790bc-1103-424e-914e-76fe9fa4197f.temp_image.93ab86e4-9cdf-4cd0-8dcd-978ab576e452mmksk_x9.img' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:14:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fec790bc-1103-424e-914e-76fe9fa4197f.temp_image.93ab86e4-9cdf-4cd0-8dcd-978ab576e452mmksk_x9.img /opt/stack/data/cinder/conversion/vol_upload_t8fqnmvh {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:14:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fec790bc-1103-424e-914e-76fe9fa4197f.temp_image.93ab86e4-9cdf-4cd0-8dcd-978ab576e452mmksk_x9.img /opt/stack/data/cinder/conversion/vol_upload_t8fqnmvh" returned: 0 in 2.078s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:14:53 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Image conversion details: src /opt/stack/data/cinder/conversion/fec790bc-1103-424e-914e-76fe9fa4197f.temp_image.93ab86e4-9cdf-4cd0-8dcd-978ab576e452mmksk_x9.img, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/conversion/vol_upload_t8fqnmvh {{(pid=83342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 22:14:53 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Converted 1024.00 MB image at 484.61 MB/s
Sep 18 22:14:53 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[637faec2-dde5-4d18-b696-bf507cc404dc]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:14:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_t8fqnmvh {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:14:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_t8fqnmvh" returned: 0 in 0.441s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:14:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.409s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:14:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Uploaded volume to glance image-id: 93ab86e4-9cdf-4cd0-8dcd-978ab576e452. {{(pid=83342) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 18 22:14:55 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-b43882eb-09e1-4327-a9a5-e3b38a4ed018 tempest-VolumesActionsTest-1930858958 None] Copy volume to image completed successfully.
Sep 18 22:14:56 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Acquiring lock "cinder-fec790bc-1103-424e-914e-76fe9fa4197f-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:14:56 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Lock "cinder-fec790bc-1103-424e-914e-76fe9fa4197f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:14:57 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:14:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Acquiring lock "cinder-quobyte-fec790bc-1103-424e-914e-76fe9fa4197f" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:14:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Lock "cinder-quobyte-fec790bc-1103-424e-914e-76fe9fa4197f" acquired by "delete_volume" :: waited 0.015s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:14:57 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ca5d1b-4218-4920-a971-a9b9d89e40cd]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:14:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:14:57 devstack quobyte-client[83360]: System call of process 91195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:14:57 devstack quobyte-client[83360]: System call of process 91195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:14:57 devstack quobyte-client[83360]: System call of process 91195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:14:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f" returned: 0 in 0.417s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:14:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:14:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-fec790bc-1103-424e-914e-76fe9fa4197f" returned: 0 in 0.111s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:14:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Lock "cinder-quobyte-fec790bc-1103-424e-914e-76fe9fa4197f" released by "delete_volume" :: held 0.698s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:14:58 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Created reservations ['8bdc21c7-0ea6-4fdd-ae37-21ec8bcc0f7e', '9cbf1696-d2a0-4e7f-b692-4b6b1b87b2a3', '9594e664-8508-4aa2-8dae-e234027f914b', 'e0fd8fc2-da5c-41d7-b45d-64e445829035'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:14:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:14:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:14:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:14:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:14:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:14:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:14:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.113s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:14:58 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:14:58 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Deleted volume successfully.
Sep 18 22:14:58 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-55ab9789-30f6-490e-8bd4-f8847a723e0b tempest-VolumesActionsTest-1930858958 None] Lock "cinder-fec790bc-1103-424e-914e-76fe9fa4197f-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:15:08 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=7,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:15:08 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=12,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:15:08 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:15:08 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:15:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Flow 'volume_create_manager' (6f3926ee-db22-479a-b86e-8515d7630d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:15:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9faa3ac8-cd28-409e-b946-6bb87966e6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:15:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9faa3ac8-cd28-409e-b946-6bb87966e6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-88122346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab7ba2f-2542-4624-9a1e-880ce0a62c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f4ca9ce9d5459a993c72ffd82ce1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:15:09Z,use_quota=True,user_id='408349258f70452e8a3db6906a5d8890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:15:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f419b2b-aa44-45e0-9294-009154ec543b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:15:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f419b2b-aa44-45e0-9294-009154ec543b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:15:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608f201d-88cb-4561-b07f-d11afaf58730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:15:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (608f201d-88cb-4561-b07f-d11afaf58730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ab7ba2f-2542-4624-9a1e-880ce0a62c8f', 'volume_name': 'volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f', 'volume_size': 1, 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b51f48f363a84a708334255554fa3921', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'created_at': datetime.datetime(2025, 9, 18, 19, 51, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 19, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e9f9b45e-88d0-41ad-b728-fb173316839e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f905453f850>}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:15:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9a2e07-363f-4a19-b28a-1e370dfee3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:15:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9a2e07-363f-4a19-b28a-1e370dfee3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:15:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af08787e-6314-4399-8e2c-64e64e3de3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:15:09 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Volume 4ab7ba2f-2542-4624-9a1e-880ce0a62c8f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f', 'volume_size': 1, 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b51f48f363a84a708334255554fa3921', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'created_at': datetime.datetime(2025, 9, 18, 19, 51, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 19, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e9f9b45e-88d0-41ad-b728-fb173316839e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f905453f850>}
Sep 18 22:15:09 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Cloning 4ab7ba2f-2542-4624-9a1e-880ce0a62c8f from image e9f9b45e-88d0-41ad-b728-fb173316839e  at location (None, None). {{(pid=83342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 18 22:15:10 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_rid6sgrwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 22:15:10 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Image download 20.69 MB at 20.69 MB/s
Sep 18 22:15:10 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ccdf3a-24aa-4a83-bd0d-e464592b0c41]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:15:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_rid6sgrwdevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:10 devstack sudo[91301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_rid6sgrwdevstack@QuobyteHD
Sep 18 22:15:10 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:15:12 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-cb01bc45-39bf-4d10-890c-d6314d2e1597 req-d8b3a75a-f45b-4067-93b1-979191f9eb1f tempest-AttachVolumeNegativeTest-1277586577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:15:12 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-cb01bc45-39bf-4d10-890c-d6314d2e1597 req-d8b3a75a-f45b-4067-93b1-979191f9eb1f tempest-AttachVolumeNegativeTest-1277586577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:15:12 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-cb01bc45-39bf-4d10-890c-d6314d2e1597 req-d8b3a75a-f45b-4067-93b1-979191f9eb1f tempest-AttachVolumeNegativeTest-1277586577 None] Terminate volume connection completed successfully.
Sep 18 22:15:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-cb01bc45-39bf-4d10-890c-d6314d2e1597 req-d8b3a75a-f45b-4067-93b1-979191f9eb1f tempest-AttachVolumeNegativeTest-1277586577 None] Deleting attachment a5c38855-d8c7-476b-bf8b-8055160ba986. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:15:13 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root
Sep 18 22:15:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_rid6sgrwdevstack@QuobyteHD" returned: 0 in 3.457s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:13 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Temporary image e9f9b45e-88d0-41ad-b728-fb173316839e is fetched for user 408349258f70452e8a3db6906a5d8890. {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 22:15:14 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[426b9888-6328-42b5-bd55-371ccc5a3fa1]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:15:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_rid6sgrwdevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:15 devstack sudo[91308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_rid6sgrwdevstack@QuobyteHD
Sep 18 22:15:15 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:15:18 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_rid6sgrwdevstack@QuobyteHD" returned: 0 in 3.416s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-88122346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ab7ba2f-2542-4624-9a1e-880ce0a62c8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f4ca9ce9d5459a993c72ffd82ce1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:15:09Z,use_quota=True,user_id='408349258f70452e8a3db6906a5d8890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Creating volume 4ab7ba2f-2542-4624-9a1e-880ce0a62c8f {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:15:18 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:18 devstack quobyte-client[83360]: System call of process 91353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:18 devstack quobyte-client[83360]: System call of process 91353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:18 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=44, name=volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f 1073741824" returned: 0 in 0.427s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f" returned: 0 in 0.131s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] <== create_volume: return (688ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:15:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:15:19 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Attempting download of e9f9b45e-88d0-41ad-b728-fb173316839e ((None, None)) to volume 4ab7ba2f-2542-4624-9a1e-880ce0a62c8f. {{(pid=83342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 22:15:19 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e590ac8-cd61-4ab2-9440-bd2526e62d90]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:15:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_y4l7c0de {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_y4l7c0de" returned: 0 in 0.731s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_y4l7c0de {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_y4l7c0de" returned: 1 in 0.781s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_y4l7c0de' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:15:21 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b498cecd-69bb-4e40-b262-d76be7f698a1]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:15:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_rid6sgrwdevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_rid6sgrwdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:21 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] e9f9b45e-88d0-41ad-b728-fb173316839e was qcow2, converting to raw {{(pid=83342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 22:15:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_rid6sgrwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:21 devstack quobyte-client[83360]: System call of process 91367 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:21 devstack quobyte-client[83360]: System call of process 91367 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:22 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=44, name=volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:15:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Acquiring lock "cinder-ca2fb73a-a237-4fdc-a858-a9443a978df6-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:15:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "cinder-ca2fb73a-a237-4fdc-a858-a9443a978df6-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:15:22 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:15:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Acquiring lock "cinder-quobyte-ca2fb73a-a237-4fdc-a858-a9443a978df6" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:15:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "cinder-quobyte-ca2fb73a-a237-4fdc-a858-a9443a978df6" acquired by "delete_volume" :: waited 0.025s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:15:22 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[750d681d-8fca-4a80-b65f-8d3969003f9a]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:15:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ca2fb73a-a237-4fdc-a858-a9443a978df6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_rid6sgrwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f" returned: 0 in 1.370s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:23 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_rid6sgrwdevstack@QuobyteHD, size 112.00 MB, duration 1.41 sec, destination /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f {{(pid=83342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 22:15:23 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Converted 112.00 MB image at 79.34 MB/s
Sep 18 22:15:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ca2fb73a-a237-4fdc-a858-a9443a978df6" returned: 0 in 0.600s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:23 devstack quobyte-client[83360]: System call of process 91377 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:23 devstack quobyte-client[83360]: System call of process 91377 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ca2fb73a-a237-4fdc-a858-a9443a978df6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f 1G" returned: 0 in 0.216s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ca2fb73a-a237-4fdc-a858-a9443a978df6" returned: 0 in 0.136s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "cinder-quobyte-ca2fb73a-a237-4fdc-a858-a9443a978df6" released by "delete_volume" :: held 0.941s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:15:23 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[45546b3b-210a-4cb3-b2ed-0e56fa5a6bb3]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:15:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:24 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Created reservations ['1f2ab148-24de-45c9-a9d0-4e12fa019a60', '40288f33-903c-423d-9f41-5e46dab18994', 'ed4356a0-5f19-461e-beee-cd0e2d2f2792', 'ef16583f-0c5d-4767-93ee-b7b1a7190369'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:15:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f" returned: 0 in 0.538s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:24 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Acquiring lock "cinder-0154a0cc-5e50-4e9a-912f-e8d71b59b304-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:15:24 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "cinder-0154a0cc-5e50-4e9a-912f-e8d71b59b304-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:15:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:15:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:15:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:15:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:15:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:15:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:24 devstack quobyte-client[83360]: System call of process 91385 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f" returned: 1 in 1.031s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:15:25 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Downloaded image e9f9b45e-88d0-41ad-b728-fb173316839e ((None, None)) to volume 4ab7ba2f-2542-4624-9a1e-880ce0a62c8f successfully. {{(pid=83342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 22:15:25 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Temporary image e9f9b45e-88d0-41ad-b728-fb173316839e for user 408349258f70452e8a3db6906a5d8890 is deleted. {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 22:15:25 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Marking volume 4ab7ba2f-2542-4624-9a1e-880ce0a62c8f as bootable. {{(pid=83342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 22:15:25 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:15:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Acquiring lock "cinder-quobyte-0154a0cc-5e50-4e9a-912f-e8d71b59b304" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:15:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.530s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:25 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:15:25 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Deleted volume successfully.
Sep 18 22:15:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "cinder-quobyte-0154a0cc-5e50-4e9a-912f-e8d71b59b304" acquired by "delete_volume" :: waited 0.111s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:15:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-420bd005-16db-437c-ac24-ed4f02ce0c98 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "cinder-ca2fb73a-a237-4fdc-a858-a9443a978df6-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:15:25 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c792e08b-0336-48e5-b8f0-7f6efe0a255a]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:15:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:25 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Copying metadata from image e9f9b45e-88d0-41ad-b728-fb173316839e to 4ab7ba2f-2542-4624-9a1e-880ce0a62c8f. {{(pid=83342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 22:15:25 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Creating volume glance metadata for volume 4ab7ba2f-2542-4624-9a1e-880ce0a62c8f backed by image e9f9b45e-88d0-41ad-b728-fb173316839e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 22:15:26 devstack quobyte-client[83360]: System call of process 91390 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:26 devstack quobyte-client[83360]: System call of process 91390 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:26 devstack quobyte-client[83360]: System call of process 91390 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af08787e-6314-4399-8e2c-64e64e3de3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f', 'volume_size': 1, 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b51f48f363a84a708334255554fa3921', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'created_at': datetime.datetime(2025, 9, 18, 19, 51, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 19, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e9f9b45e-88d0-41ad-b728-fb173316839e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f905453f850>}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:15:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1ff683-ea38-439d-9212-2e585d502632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:15:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304" returned: 0 in 0.709s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0154a0cc-5e50-4e9a-912f-e8d71b59b304" returned: 0 in 0.137s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:26 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "cinder-quobyte-0154a0cc-5e50-4e9a-912f-e8d71b59b304" released by "delete_volume" :: held 1.015s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:15:26 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Volume volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f (4ab7ba2f-2542-4624-9a1e-880ce0a62c8f): created successfully
Sep 18 22:15:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a1ff683-ea38-439d-9212-2e585d502632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:15:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Flow 'volume_create_manager' (6f3926ee-db22-479a-b86e-8515d7630d43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:15:26 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-9b753933-c459-4bb0-9e90-0f321aa146c0 tempest-VolumesExtendTest-838447268 None] Created volume successfully.
Sep 18 22:15:26 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Created reservations ['f10c1923-0f0b-4988-992e-b4fbcef66607', 'bcac2222-1ad4-4381-a968-08e4b92f2068', 'a70f70b5-e7a2-47c5-bf4a-5cf1b2b4fab6', '651fc652-5773-4ea8-ac5c-126318ddd3e0'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:15:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:15:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:15:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:15:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:15:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:15:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.159s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:27 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:15:27 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Deleted volume successfully.
Sep 18 22:15:27 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e5184d70-69a7-4658-a30a-37c080fdf7a2 tempest-VolumesExtendTest-838447268 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:15:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e5184d70-69a7-4658-a30a-37c080fdf7a2 tempest-VolumesExtendTest-838447268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:15:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e5184d70-69a7-4658-a30a-37c080fdf7a2 tempest-VolumesExtendTest-838447268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.007s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:15:27 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0778240-2d9f-4d61-884f-e651e93c33ec]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:15:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e5184d70-69a7-4658-a30a-37c080fdf7a2 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:28 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-db27682e-3011-4843-8788-d468339cd2d9 tempest-AttachVolumeShelveTestJSON-1275355314 None] Lock "cinder-0154a0cc-5e50-4e9a-912f-e8d71b59b304-delete_volume" released by "delete_volume" :: held 3.279s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:15:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e5184d70-69a7-4658-a30a-37c080fdf7a2 tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f" returned: 0 in 0.572s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e5184d70-69a7-4658-a30a-37c080fdf7a2 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:28 devstack quobyte-client[83360]: System call of process 91403 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e5184d70-69a7-4658-a30a-37c080fdf7a2 tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f" returned: 1 in 0.518s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e5184d70-69a7-4658-a30a-37c080fdf7a2 tempest-VolumesExtendTest-838447268 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:15:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e5184d70-69a7-4658-a30a-37c080fdf7a2 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f 2G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e5184d70-69a7-4658-a30a-37c080fdf7a2 tempest-VolumesExtendTest-838447268 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f 2G" returned: 0 in 0.205s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e5184d70-69a7-4658-a30a-37c080fdf7a2 tempest-VolumesExtendTest-838447268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.441s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:15:29 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e5184d70-69a7-4658-a30a-37c080fdf7a2 tempest-VolumesExtendTest-838447268 None] Extend volume completed successfully.
Sep 18 22:15:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Acquiring lock "cinder-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:15:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Lock "cinder-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:15:30 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:15:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Acquiring lock "cinder-quobyte-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:15:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Lock "cinder-quobyte-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f" acquired by "delete_volume" :: waited 0.014s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:15:30 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be3d7d1-3d0b-43d9-9add-832315427c45]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:15:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f" returned: 0 in 0.572s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:31 devstack quobyte-client[83360]: System call of process 91413 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f" returned: 1 in 0.870s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:15:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f" returned: 0 in 0.149s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Lock "cinder-quobyte-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f" released by "delete_volume" :: held 1.930s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:15:32 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Created reservations ['a95050b0-4089-4b99-97fa-5ec4c32672e6', 'fbd03de8-390b-463d-b33b-fb21da9be0f4', 'd994c4a1-1b3f-4a45-8bf2-0afa15249928', '2ea79a88-c8bc-4456-9a56-6b66b10aaeee'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:15:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:15:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:15:32 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:15:32 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:15:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:15:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.131s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:33 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:15:33 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Deleted volume successfully.
Sep 18 22:15:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-969915a3-366f-45b3-a5a3-c9d6fb7ca86b tempest-VolumesExtendTest-838447268 None] Lock "cinder-4ab7ba2f-2542-4624-9a1e-880ce0a62c8f-delete_volume" released by "delete_volume" :: held 3.340s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:15:34 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Flow 'volume_create_manager' (8ac06fea-f9fc-4ea5-8879-fdf02ab3613f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc34dea9-9d71-4858-b6f6-6b1602949048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc34dea9-9d71-4858-b6f6-6b1602949048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-250506588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae0d15c-6b15-4eb5-b890-4bc06eb976b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f4ca9ce9d5459a993c72ffd82ce1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:15:34Z,use_quota=True,user_id='408349258f70452e8a3db6906a5d8890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c855ac62-da46-4bde-aee2-4b561addc8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c855ac62-da46-4bde-aee2-4b561addc8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84699a80-354b-4288-9319-b822f50b2d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84699a80-354b-4288-9319-b822f50b2d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ae0d15c-6b15-4eb5-b890-4bc06eb976b2', 'volume_name': 'volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5ed4da-991c-4ea5-9c75-a03d31c35f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5ed4da-991c-4ea5-9c75-a03d31c35f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaab8e29-95de-4bc4-949c-cdf6ddb39769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:15:34 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Volume 9ae0d15c-6b15-4eb5-b890-4bc06eb976b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2', 'volume_size': 1}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-250506588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae0d15c-6b15-4eb5-b890-4bc06eb976b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f4ca9ce9d5459a993c72ffd82ce1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:15:34Z,use_quota=True,user_id='408349258f70452e8a3db6906a5d8890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Creating volume 9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:15:34 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:15:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:34 devstack quobyte-client[83360]: System call of process 91418 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:34 devstack quobyte-client[83360]: System call of process 91418 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:34 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=45, name=volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:15:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 1073741824" returned: 0 in 0.445s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2" returned: 0 in 0.134s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] <== create_volume: return (683ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:15:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:15:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaab8e29-95de-4bc4-949c-cdf6ddb39769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:15:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e466e1ff-9e57-49b0-a128-96fdec3f6e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:15:35 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Volume volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 (9ae0d15c-6b15-4eb5-b890-4bc06eb976b2): created successfully
Sep 18 22:15:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e466e1ff-9e57-49b0-a128-96fdec3f6e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:15:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Flow 'volume_create_manager' (8ac06fea-f9fc-4ea5-8879-fdf02ab3613f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:15:35 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-5034eced-bbcb-4081-8ba2-d7dc08427e81 tempest-VolumesExtendTest-838447268 None] Created volume successfully.
Sep 18 22:15:36 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:15:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:15:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:15:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] Creating offline snapshot 2e48eee6-3af5-410d-b60b-3bf2c6c6b296 of volume 9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:15:37 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a20a11-6e98-4b2a-814f-1812e04bea7f]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:15:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:37 devstack quobyte-client[83360]: System call of process 91423 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2" returned: 0 in 0.525s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:37 devstack quobyte-client[83360]: System call of process 91426 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:37 devstack quobyte-client[83360]: System call of process 91426 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:37 devstack quobyte-client[83360]: System call of process 91426 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:37 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=46, name=volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:15:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296 1G" returned: 0 in 0.307s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): qemu-img rebase -u -b volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] CMD "qemu-img rebase -u -b volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296" returned: 0 in 0.237s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:15:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296" returned: 0 in 0.193s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:15:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296" returned: 0 in 0.146s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.info" returned: 0 in 0.142s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:15:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.info" returned: 0 in 0.158s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:15:39 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-29fd4acb-59d6-4c63-b63b-5ef26ab07f66 tempest-VolumesExtendTest-838447268 None] Create snapshot completed successfully
Sep 18 22:15:40 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-0f99a637-0a1f-4f7d-aa15-60b9daec57d6 tempest-VolumesExtendTest-838447268 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:15:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0f99a637-0a1f-4f7d-aa15-60b9daec57d6 tempest-VolumesExtendTest-838447268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:15:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0f99a637-0a1f-4f7d-aa15-60b9daec57d6 tempest-VolumesExtendTest-838447268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.018s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:15:40 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[25064b37-d45e-4cfa-8299-ea3c03e9e216]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:15:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0f99a637-0a1f-4f7d-aa15-60b9daec57d6 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:41 devstack quobyte-client[83360]: System call of process 91441 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0f99a637-0a1f-4f7d-aa15-60b9daec57d6 tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2" returned: 0 in 0.817s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0f99a637-0a1f-4f7d-aa15-60b9daec57d6 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296 2G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:41 devstack quobyte-client[83360]: System call of process 91450 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:41 devstack quobyte-client[83360]: System call of process 91450 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0f99a637-0a1f-4f7d-aa15-60b9daec57d6 tempest-VolumesExtendTest-838447268 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296 2G" returned: 0 in 0.370s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0f99a637-0a1f-4f7d-aa15-60b9daec57d6 tempest-VolumesExtendTest-838447268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.368s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:15:42 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-0f99a637-0a1f-4f7d-aa15-60b9daec57d6 tempest-VolumesExtendTest-838447268 None] Extend volume completed successfully.
Sep 18 22:15:43 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Acquiring lock "cinder-2e48eee6-3af5-410d-b60b-3bf2c6c6b296-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:15:43 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Lock "cinder-2e48eee6-3af5-410d-b60b-3bf2c6c6b296-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:15:43 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:15:43 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Acquiring lock "cinder-quobyte-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:15:43 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Lock "cinder-quobyte-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2" acquired by "delete_snapshot" :: waited 0.036s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:15:43 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Acquiring lock "cinder-quobyte-2e48eee6-3af5-410d-b60b-3bf2c6c6b296" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:15:43 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Lock "cinder-quobyte-2e48eee6-3af5-410d-b60b-3bf2c6c6b296" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:15:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Deleting offline snapshot 2e48eee6-3af5-410d-b60b-3bf2c6c6b296 of volume 9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:15:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] snapshot_file for this snap is: volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:15:43 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d83716-9edd-4224-aaf1-6dc18ee2d8d6]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:15:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:44 devstack quobyte-client[83360]: System call of process 91459 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296" returned: 0 in 0.765s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:15:44 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[afabdaf8-9a97-454c-b88b-2eecf6d413a6]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:15:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:44 devstack quobyte-client[83360]: System call of process 91463 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:44 devstack quobyte-client[83360]: System call of process 91463 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:44 devstack quobyte-client[83360]: System call of process 91463 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2" returned: 0 in 0.717s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296" returned: 0 in 0.381s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2.2e48eee6-3af5-410d-b60b-3bf2c6c6b296" returned: 0 in 0.164s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Lock "cinder-quobyte-2e48eee6-3af5-410d-b60b-3bf2c6c6b296" released by "_delete_snapshot" :: held 2.462s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:15:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Lock "cinder-quobyte-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2" released by "delete_snapshot" :: held 2.494s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:15:46 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Created reservations ['b0db79fd-2d1a-4d24-8ae3-3c714acda40c', 'd8b5308b-f068-4dfd-b465-95333d9864a5', 'e0d57b2c-cc64-4f32-a06c-8547f81ede9b', 'a1b3aa9c-9079-4391-a41e-dc48dbab98ed'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:15:46 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Delete snapshot completed successfully.
Sep 18 22:15:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dcd189ec-e488-42b3-9496-5878af67cb79 tempest-VolumesExtendTest-838447268 None] Lock "cinder-2e48eee6-3af5-410d-b60b-3bf2c6c6b296-delete_snapshot" released by "delete_snapshot" :: held 3.054s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:15:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Acquiring lock "cinder-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:15:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Lock "cinder-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:15:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:15:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:15:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:15:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:15:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:15:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:15:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:46 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:15:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Acquiring lock "cinder-quobyte-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:15:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.344s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:15:47 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Lock "cinder-quobyte-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2" acquired by "delete_volume" :: waited 0.245s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:15:47 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a41f75-0651-4c30-a7b0-052d7edf37cd]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:15:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:47 devstack quobyte-client[83360]: System call of process 91475 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:15:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2" returned: 0 in 0.675s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2" returned: 0 in 0.129s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:48 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Lock "cinder-quobyte-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2" released by "delete_volume" :: held 1.026s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:15:48 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Created reservations ['915f8f38-e51f-44b2-8a22-5b618b65fc38', 'f74fa8e7-18e7-4ccb-b8e8-1c0ac1040e27', 'd1c6e4b7-151f-4cb0-9e3b-346e9f805716', 'a2450b22-8548-4c00-8ab3-e5c98f458bfd'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:15:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:15:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:15:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:15:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:15:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.132s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:15:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:15:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.265s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:15:49 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:15:49 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Deleted volume successfully.
Sep 18 22:15:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0ab2ceac-2b85-4480-82d1-5303d6bc89e7 tempest-VolumesExtendTest-838447268 None] Lock "cinder-9ae0d15c-6b15-4eb5-b890-4bc06eb976b2-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:15:58 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=37,cinder:INSERT=17,cinder:UPDATE=52,cinder:DELETE=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:15:59 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=47,cinder:SELECT=43,cinder:INSERT=16,cinder:DELETE=5 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:16:02 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Flow 'volume_create_manager' (8d163e2f-b04e-4ff5-9e69-26c0158f6ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ab5bf4-36b1-4b80-a495-11d1280784c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ab5bf4-36b1-4b80-a495-11d1280784c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-37107510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7199173-242b-4338-a44e-8ae35f83e3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2611d6c8f5e4a4b83f92752d725df65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:16:02Z,use_quota=True,user_id='4b8104fee6e844699de8ac23a8cbbc51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631394fc-85f1-4a7a-8533-204c88e3f71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631394fc-85f1-4a7a-8533-204c88e3f71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1ab68a-31b4-411e-b9c8-01fa8fb4d3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1ab68a-31b4-411e-b9c8-01fa8fb4d3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7199173-242b-4338-a44e-8ae35f83e3d9', 'volume_name': 'volume-c7199173-242b-4338-a44e-8ae35f83e3d9', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679f1909-44fd-4b5f-b58f-39ced5c8aab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679f1909-44fd-4b5f-b58f-39ced5c8aab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf21e76-8bf6-4866-93b4-2a0af0d867eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:16:02 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Volume c7199173-242b-4338-a44e-8ae35f83e3d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7199173-242b-4338-a44e-8ae35f83e3d9', 'volume_size': 1}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:16:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-37107510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7199173-242b-4338-a44e-8ae35f83e3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2611d6c8f5e4a4b83f92752d725df65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:16:02Z,use_quota=True,user_id='4b8104fee6e844699de8ac23a8cbbc51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Creating volume c7199173-242b-4338-a44e-8ae35f83e3d9 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:16:02 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:16:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:02 devstack quobyte-client[83360]: System call of process 91562 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:02 devstack quobyte-client[83360]: System call of process 91562 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:03 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=48, name=volume-c7199173-242b-4338-a44e-8ae35f83e3d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:16:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9 1073741824" returned: 0 in 0.894s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9" returned: 0 in 0.324s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:03 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] <== create_volume: return (1382ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:16:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:16:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf21e76-8bf6-4866-93b4-2a0af0d867eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7199173-242b-4338-a44e-8ae35f83e3d9', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:16:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3badcc5e-e24e-4306-84be-cceb00b926ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:16:04 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Volume volume-c7199173-242b-4338-a44e-8ae35f83e3d9 (c7199173-242b-4338-a44e-8ae35f83e3d9): created successfully
Sep 18 22:16:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3badcc5e-e24e-4306-84be-cceb00b926ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:16:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Flow 'volume_create_manager' (8d163e2f-b04e-4ff5-9e69-26c0158f6ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:16:04 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-973761a4-bb8e-4333-bb15-658b365d7856 tempest-VolumesSnapshotListTestJSON-1492027934 None] Created volume successfully.
Sep 18 22:16:05 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:16:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:16:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:16:05 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] Creating offline snapshot df43778a-f291-42e6-82d6-fefbbb57e3a5 of volume c7199173-242b-4338-a44e-8ae35f83e3d9 {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:16:05 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f39631-1317-4dc5-b8ca-f1e81506dac8]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:16:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:06 devstack quobyte-client[83360]: System call of process 91597 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9" returned: 0 in 1.202s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:07 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=49, name=volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:16:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 1G" returned: 0 in 0.312s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c7199173-242b-4338-a44e-8ae35f83e3d9 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:07 devstack quobyte-client[83360]: System call of process 91605 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "qemu-img rebase -u -b volume-c7199173-242b-4338-a44e-8ae35f83e3d9 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5" returned: 0 in 0.138s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:07 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:16:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5" returned: 0 in 0.126s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:07 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:16:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5" returned: 0 in 0.138s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.info" returned: 0 in 0.109s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:07 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:16:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.info" returned: 0 in 0.140s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.756s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:16:08 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-3ee19326-75c8-4777-b3e1-9f8e2ff453be tempest-VolumesSnapshotListTestJSON-1492027934 None] Create snapshot completed successfully
Sep 18 22:16:08 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:16:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:16:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.017s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:16:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] Creating offline snapshot 89994c26-c34b-4d24-9f87-1e1b8dc660e5 of volume c7199173-242b-4338-a44e-8ae35f83e3d9 {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:16:09 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2bbbe6-9d86-4db3-ba2a-214dbbf6c5c5]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:16:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5" returned: 0 in 0.582s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7199173-242b-4338-a44e-8ae35f83e3d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:16:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:10 devstack quobyte-client[83360]: System call of process 91616 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:10 devstack quobyte-client[83360]: System call of process 91616 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:10 devstack quobyte-client[83360]: System call of process 91616 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:10 devstack quobyte-client[83360]: System call of process 91616 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:10 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=51, name=volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:16:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 1G" returned: 0 in 0.498s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:10 devstack quobyte-client[83360]: System call of process 91620 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:10 devstack quobyte-client[83360]: System call of process 91620 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "qemu-img rebase -u -b volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5" returned: 0 in 0.247s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:16:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5" returned: 0 in 0.141s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:16:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5" returned: 0 in 0.248s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:16:11 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-2d4f2c60-fb1b-42b2-8948-1d625a65b58c tempest-VolumesSnapshotListTestJSON-1492027934 None] Create snapshot completed successfully
Sep 18 22:16:12 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:16:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:16:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:16:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] Creating offline snapshot c1e30aeb-a996-471a-9777-8528a3f9a44a of volume c7199173-242b-4338-a44e-8ae35f83e3d9 {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:16:13 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b71797-03b2-4409-ab3c-4b8771cbfebf]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:16:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:14 devstack quobyte-client[83360]: System call of process 91625 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5" returned: 0 in 1.631s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7199173-242b-4338-a44e-8ae35f83e3d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:16:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:15 devstack quobyte-client[83360]: System call of process 91631 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:15 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=52, name=volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:16:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a 1G" returned: 0 in 0.693s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:15 devstack quobyte-client[83360]: System call of process 91635 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:15 devstack quobyte-client[83360]: System call of process 91635 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:15 devstack quobyte-client[83360]: System call of process 91635 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "qemu-img rebase -u -b volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a" returned: 0 in 0.384s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:16:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a" returned: 0 in 0.249s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:16:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a" returned: 0 in 0.314s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.069s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:16:17 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-adf42629-d5f8-481b-963f-fc0e6cbdea29 tempest-VolumesSnapshotListTestJSON-1492027934 None] Create snapshot completed successfully
Sep 18 22:16:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "cinder-c1e30aeb-a996-471a-9777-8528a3f9a44a-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:16:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-c1e30aeb-a996-471a-9777-8528a3f9a44a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:16:20 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:16:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "cinder-quobyte-c7199173-242b-4338-a44e-8ae35f83e3d9" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:16:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-quobyte-c7199173-242b-4338-a44e-8ae35f83e3d9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:16:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "cinder-quobyte-c1e30aeb-a996-471a-9777-8528a3f9a44a" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:16:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-quobyte-c1e30aeb-a996-471a-9777-8528a3f9a44a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:16:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Deleting offline snapshot c1e30aeb-a996-471a-9777-8528a3f9a44a of volume c7199173-242b-4338-a44e-8ae35f83e3d9 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:16:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] snapshot_file for this snap is: volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:16:20 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4dca1b-5b8d-4838-a8b0-0cf23c555d12]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:16:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:21 devstack quobyte-client[83360]: System call of process 91653 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:21 devstack quobyte-client[83360]: System call of process 91653 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a" returned: 0 in 0.621s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7199173-242b-4338-a44e-8ae35f83e3d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:16:21 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[710cc991-e57c-4edc-9f25-d04e9ce1b2dd]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:16:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:21 devstack quobyte-client[83360]: System call of process 91656 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5" returned: 0 in 0.494s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7199173-242b-4338-a44e-8ae35f83e3d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:16:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:22 devstack quobyte-client[83360]: System call of process 91659 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a" returned: 0 in 0.325s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.c1e30aeb-a996-471a-9777-8528a3f9a44a" returned: 0 in 0.138s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-quobyte-c1e30aeb-a996-471a-9777-8528a3f9a44a" released by "_delete_snapshot" :: held 2.075s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:16:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-quobyte-c7199173-242b-4338-a44e-8ae35f83e3d9" released by "delete_snapshot" :: held 2.106s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:16:23 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Created reservations ['269565ca-e0c7-4968-a017-67896fb200b2', 'bc69174d-50f0-42d4-bfed-de1bd46d4bfd', '774e7099-30b1-4dbc-92d1-d6cd74eeb574', 'a38fcc48-ec39-4746-9c4c-835686cb5f1c'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:16:23 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Delete snapshot completed successfully.
Sep 18 22:16:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-627257fd-84a2-44df-a514-70a9a0251bdd tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-c1e30aeb-a996-471a-9777-8528a3f9a44a-delete_snapshot" released by "delete_snapshot" :: held 2.658s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:16:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "cinder-89994c26-c34b-4d24-9f87-1e1b8dc660e5-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:16:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-89994c26-c34b-4d24-9f87-1e1b8dc660e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:16:23 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:16:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "cinder-quobyte-c7199173-242b-4338-a44e-8ae35f83e3d9" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:16:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-quobyte-c7199173-242b-4338-a44e-8ae35f83e3d9" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:16:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "cinder-quobyte-89994c26-c34b-4d24-9f87-1e1b8dc660e5" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:16:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-quobyte-89994c26-c34b-4d24-9f87-1e1b8dc660e5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:16:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Deleting offline snapshot 89994c26-c34b-4d24-9f87-1e1b8dc660e5 of volume c7199173-242b-4338-a44e-8ae35f83e3d9 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:16:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] snapshot_file for this snap is: volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:16:23 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[242b71b9-186b-42cf-8b61-9d2630acb3f5]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:16:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5" returned: 0 in 0.462s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7199173-242b-4338-a44e-8ae35f83e3d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:16:24 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d30743-69e3-4aff-be8e-5a4ff46705c2]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:16:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:25 devstack quobyte-client[83360]: System call of process 91670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:25 devstack quobyte-client[83360]: System call of process 91670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:25 devstack quobyte-client[83360]: System call of process 91670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5" returned: 0 in 0.841s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:25 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7199173-242b-4338-a44e-8ae35f83e3d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:16:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:25 devstack quobyte-client[83360]: System call of process 91678 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:25 devstack quobyte-client[83360]: System call of process 91678 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:25 devstack quobyte-client[83360]: System call of process 91678 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5" returned: 0 in 0.415s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.89994c26-c34b-4d24-9f87-1e1b8dc660e5" returned: 0 in 0.207s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:26 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-quobyte-89994c26-c34b-4d24-9f87-1e1b8dc660e5" released by "_delete_snapshot" :: held 2.377s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:16:26 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-quobyte-c7199173-242b-4338-a44e-8ae35f83e3d9" released by "delete_snapshot" :: held 2.420s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:16:26 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Created reservations ['25514c79-e3c1-4867-b6bf-4dc3b51f0543', '82e9fdc1-c32d-4e7c-9f33-e4c978ef0477', 'f40b0540-9bfb-489c-a4de-95e6152f9924', '60da4d71-3ab7-46d0-90f6-135ce4bc7a2b'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:16:27 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Delete snapshot completed successfully.
Sep 18 22:16:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8d749d3b-04d5-41b1-9509-fbece03aa080 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-89994c26-c34b-4d24-9f87-1e1b8dc660e5-delete_snapshot" released by "delete_snapshot" :: held 3.299s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:16:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "cinder-df43778a-f291-42e6-82d6-fefbbb57e3a5-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:16:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-df43778a-f291-42e6-82d6-fefbbb57e3a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:16:27 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:16:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "cinder-quobyte-c7199173-242b-4338-a44e-8ae35f83e3d9" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:16:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-quobyte-c7199173-242b-4338-a44e-8ae35f83e3d9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:16:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "cinder-quobyte-df43778a-f291-42e6-82d6-fefbbb57e3a5" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:16:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-quobyte-df43778a-f291-42e6-82d6-fefbbb57e3a5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:16:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Deleting offline snapshot df43778a-f291-42e6-82d6-fefbbb57e3a5 of volume c7199173-242b-4338-a44e-8ae35f83e3d9 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:16:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] snapshot_file for this snap is: volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:16:27 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3763d1d-ad30-4d22-8fc2-1c55e479f4e5]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:16:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:29 devstack quobyte-client[83360]: System call of process 91716 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5" returned: 0 in 1.772s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7199173-242b-4338-a44e-8ae35f83e3d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:16:29 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[912a12c1-266d-4bc7-9633-ae8ccafad293]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:16:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:30 devstack quobyte-client[83360]: System call of process 91754 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:30 devstack quobyte-client[83360]: System call of process 91754 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:30 devstack quobyte-client[83360]: System call of process 91754 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9" returned: 0 in 1.081s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:31 devstack quobyte-client[83360]: System call of process 91782 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5" returned: 0 in 0.456s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9.df43778a-f291-42e6-82d6-fefbbb57e3a5" returned: 0 in 0.264s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-quobyte-df43778a-f291-42e6-82d6-fefbbb57e3a5" released by "_delete_snapshot" :: held 4.819s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:16:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-quobyte-c7199173-242b-4338-a44e-8ae35f83e3d9" released by "delete_snapshot" :: held 4.894s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:16:32 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Created reservations ['fb387f80-64be-4e84-940c-823e083f8098', 'cf60ffe6-d593-475d-946a-9e83e32a397e', 'c999a150-54eb-473f-a278-558c57c8ae87', '12f31fed-0bfc-4162-8adb-ab4683d84a62'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:16:33 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Delete snapshot completed successfully.
Sep 18 22:16:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a8324f61-b3e7-4898-8a0e-946b9a9b8523 tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-df43778a-f291-42e6-82d6-fefbbb57e3a5-delete_snapshot" released by "delete_snapshot" :: held 5.855s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:16:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "cinder-c7199173-242b-4338-a44e-8ae35f83e3d9-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:16:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-c7199173-242b-4338-a44e-8ae35f83e3d9-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:16:34 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:16:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "cinder-quobyte-c7199173-242b-4338-a44e-8ae35f83e3d9" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:16:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-quobyte-c7199173-242b-4338-a44e-8ae35f83e3d9" acquired by "delete_volume" :: waited 0.021s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:16:34 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[41633d08-9a1f-41e5-bff0-afe2910bbe87]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:16:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:34 devstack quobyte-client[83360]: System call of process 91800 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:16:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9" returned: 0 in 0.565s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c7199173-242b-4338-a44e-8ae35f83e3d9" returned: 0 in 0.235s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:35 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-quobyte-c7199173-242b-4338-a44e-8ae35f83e3d9" released by "delete_volume" :: held 1.114s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:16:35 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Created reservations ['119231a2-3a60-43ca-b110-667499e43a65', '9ef6716f-795b-423f-aae2-f20ac51c1915', '72c95eb1-4260-42b0-b1b9-11b7dfd28b49', '6eae231b-fd63-4b2e-987a-abc7d7097eed'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:16:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:16:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:16:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:16:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:16:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:16:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.101s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:36 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:16:36 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Deleted volume successfully.
Sep 18 22:16:36 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7b032b10-85ec-49ce-bc3a-d3afaa38aa5a tempest-VolumesSnapshotListTestJSON-1492027934 None] Lock "cinder-c7199173-242b-4338-a44e-8ae35f83e3d9-delete_volume" released by "delete_volume" :: held 2.253s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:16:45 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=27,cinder:SELECT=22,cinder:DELETE=1,cinder:INSERT=8 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:16:46 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=26,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=8 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:16:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:16:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:16:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:16:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:16:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:16:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:16:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:16:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.264s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:16:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:17:09 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Flow 'volume_create_manager' (31ee0fa1-dedb-465f-8d8d-c4d8896793ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7870cd6c-c32d-4ce0-881d-426b64ebcff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7870cd6c-c32d-4ce0-881d-426b64ebcff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2076917171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94884fd6-e3a9-4af3-87df-b7258e0e9e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0bf6a603d834826bcdcdca9ab8a6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:17:09Z,use_quota=True,user_id='0c30399c19374fd6bdfc764ff35b042f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed013783-b79d-4b8f-a43a-6c32bbdced8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed013783-b79d-4b8f-a43a-6c32bbdced8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd11f123-9c2c-4f45-a230-82a1362473fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd11f123-9c2c-4f45-a230-82a1362473fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94884fd6-e3a9-4af3-87df-b7258e0e9e6d', 'volume_name': 'volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0205c0f4-7a7b-489b-aa45-bbd8032f1292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0205c0f4-7a7b-489b-aa45-bbd8032f1292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f3ed09-7aea-4dea-9562-807cb593d7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:10 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Volume 94884fd6-e3a9-4af3-87df-b7258e0e9e6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d', 'volume_size': 1}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2076917171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94884fd6-e3a9-4af3-87df-b7258e0e9e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0bf6a603d834826bcdcdca9ab8a6172',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:17:09Z,use_quota=True,user_id='0c30399c19374fd6bdfc764ff35b042f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Creating volume 94884fd6-e3a9-4af3-87df-b7258e0e9e6d {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:17:10 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:17:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:10 devstack quobyte-client[83360]: System call of process 91940 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:17:10 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=53, name=volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:17:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d 1073741824" returned: 0 in 0.958s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d" returned: 0 in 0.415s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] <== create_volume: return (1531ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:17:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:17:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f3ed09-7aea-4dea-9562-807cb593d7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53da274-4972-4e93-a540-bebb5dc29275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:12 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Volume volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d (94884fd6-e3a9-4af3-87df-b7258e0e9e6d): created successfully
Sep 18 22:17:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e53da274-4972-4e93-a540-bebb5dc29275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Flow 'volume_create_manager' (31ee0fa1-dedb-465f-8d8d-c4d8896793ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:17:12 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a98ce48f-1318-4de2-93d1-c6be3c08720a tempest-AttachVolumeNegativeTest-1277586577 None] Created volume successfully.
Sep 18 22:17:15 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:17:15 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:17:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Flow 'volume_create_manager' (688dfcba-131f-4f64-8750-b5da27662e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:17:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b55673-ecb8-46d0-8668-b9674ecb2093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b55673-ecb8-46d0-8668-b9674ecb2093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1389253884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d744114-00f2-49ed-8b4b-e7b1cc5939fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18f3e8f057e41ba950380582047a36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:17:16Z,use_quota=True,user_id='5ed9ac6a95c948fa8ee33bb94cc1e180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(563cf973-7fe3-4ed8-b34c-ba58c0158a4e),volume_type_id=563cf973-7fe3-4ed8-b34c-ba58c0158a4e)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035866de-3594-4c58-a5d5-4e53adfd7912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035866de-3594-4c58-a5d5-4e53adfd7912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cfcd59-4e66-48af-ac0a-96014b111c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cfcd59-4e66-48af-ac0a-96014b111c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d744114-00f2-49ed-8b4b-e7b1cc5939fc', 'volume_name': 'volume-4d744114-00f2-49ed-8b4b-e7b1cc5939fc', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6adbc7dd-f044-4664-9ac0-5665d5866d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6adbc7dd-f044-4664-9ac0-5665d5866d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c8dbfb-130e-4b42-9f6f-1b2c3ce930c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:16 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume 4d744114-00f2-49ed-8b4b-e7b1cc5939fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d744114-00f2-49ed-8b4b-e7b1cc5939fc', 'volume_size': 1}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1389253884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d744114-00f2-49ed-8b4b-e7b1cc5939fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18f3e8f057e41ba950380582047a36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:17:16Z,use_quota=True,user_id='5ed9ac6a95c948fa8ee33bb94cc1e180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(563cf973-7fe3-4ed8-b34c-ba58c0158a4e),volume_type_id=563cf973-7fe3-4ed8-b34c-ba58c0158a4e)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Creating volume 4d744114-00f2-49ed-8b4b-e7b1cc5939fc {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:17:16 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4d744114-00f2-49ed-8b4b-e7b1cc5939fc 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:16 devstack quobyte-client[83360]: System call of process 91944 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:17:16 devstack quobyte-client[83360]: System call of process 91944 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:17:16 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=54, name=volume-4d744114-00f2-49ed-8b4b-e7b1cc5939fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:17:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4d744114-00f2-49ed-8b4b-e7b1cc5939fc 1073741824" returned: 0 in 0.758s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:16 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:17:17 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:17:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Flow 'volume_create_manager' (b6a2bcfb-a661-4f18-9896-c6d77f38b3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:17:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc56677-a3b7-48ba-b103-5fabf791538d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4d744114-00f2-49ed-8b4b-e7b1cc5939fc {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfc56677-a3b7-48ba-b103-5fabf791538d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1363805378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a480ac5-5f77-47e5-9708-2e9421c76e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18f3e8f057e41ba950380582047a36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:17:16Z,use_quota=True,user_id='5ed9ac6a95c948fa8ee33bb94cc1e180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53627d00-f227-4f9c-8e15-3c14ce57a9c9),volume_type_id=53627d00-f227-4f9c-8e15-3c14ce57a9c9)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2297b495-05b9-4e6a-8b9d-850b9f5b90a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2297b495-05b9-4e6a-8b9d-850b9f5b90a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12f27d5-8092-421d-a1e3-eeef6587c54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12f27d5-8092-421d-a1e3-eeef6587c54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a480ac5-5f77-47e5-9708-2e9421c76e7e', 'volume_name': 'volume-6a480ac5-5f77-47e5-9708-2e9421c76e7e', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c0a667-10de-4022-a1fc-21c85de92ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c0a667-10de-4022-a1fc-21c85de92ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b961fe3-ca39-4f30-b5ef-0e7620b3bd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:18 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume 6a480ac5-5f77-47e5-9708-2e9421c76e7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a480ac5-5f77-47e5-9708-2e9421c76e7e', 'volume_size': 1}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:17:18 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Flow 'volume_create_manager' (50b8bd8a-c4d0-4937-9c4d-0666832cad6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2ef614-755f-4e90-8469-8d8e2dab6033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4d744114-00f2-49ed-8b4b-e7b1cc5939fc" returned: 0 in 0.765s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2ef614-755f-4e90-8469-8d8e2dab6033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-835187864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709607cd-3c91-4caa-a5e1-9bf13e5848a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18f3e8f057e41ba950380582047a36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:17:17Z,use_quota=True,user_id='5ed9ac6a95c948fa8ee33bb94cc1e180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bff8d87-ae06-4047-9ed9-170759ecae92),volume_type_id=7bff8d87-ae06-4047-9ed9-170759ecae92)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d00abe-40dd-4f49-8003-927631cf58c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d00abe-40dd-4f49-8003-927631cf58c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092dbb3f-6b49-41cf-9c97-b4dc7056bd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] <== create_volume: return (2072ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.171s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1363805378',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a480ac5-5f77-47e5-9708-2e9421c76e7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18f3e8f057e41ba950380582047a36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:17:16Z,use_quota=True,user_id='5ed9ac6a95c948fa8ee33bb94cc1e180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(53627d00-f227-4f9c-8e15-3c14ce57a9c9),volume_type_id=53627d00-f227-4f9c-8e15-3c14ce57a9c9)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Creating volume 6a480ac5-5f77-47e5-9708-2e9421c76e7e {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:17:18 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a480ac5-5f77-47e5-9708-2e9421c76e7e 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:18 devstack quobyte-client[83360]: System call of process 91956 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:17:18 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=55, name=volume-6a480ac5-5f77-47e5-9708-2e9421c76e7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26c8dbfb-130e-4b42-9f6f-1b2c3ce930c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d744114-00f2-49ed-8b4b-e7b1cc5939fc', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cfca12d-3b78-4f67-bb85-7a570a45cca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a480ac5-5f77-47e5-9708-2e9421c76e7e 1073741824" returned: 0 in 0.636s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a480ac5-5f77-47e5-9708-2e9421c76e7e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-9f8fa8ab-9cd2-4bf8-b4b8-69e06150fff7 req-115d99be-9f52-4dcc-ac72-ace2e7434fa3 tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:17:19 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume volume-4d744114-00f2-49ed-8b4b-e7b1cc5939fc (4d744114-00f2-49ed-8b4b-e7b1cc5939fc): created successfully
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cfca12d-3b78-4f67-bb85-7a570a45cca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Flow 'volume_create_manager' (688dfcba-131f-4f64-8750-b5da27662e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a480ac5-5f77-47e5-9708-2e9421c76e7e" returned: 0 in 0.470s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] <== create_volume: return (1135ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092dbb3f-6b49-41cf-9c97-b4dc7056bd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '709607cd-3c91-4caa-a5e1-9bf13e5848a0', 'volume_name': 'volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0', 'volume_size': 1, 'image_id': 'cd0698d5-d756-487e-9386-d1abaf6fc7e1', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--898536221', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e18f3e8f057e41ba950380582047a36f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0698d5-d756-487e-9386-d1abaf6fc7e1', 'created_at': datetime.datetime(2025, 9, 18, 20, 17, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 20, 17, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0698d5-d756-487e-9386-d1abaf6fc7e1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f90546ba440>}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3d0da0-68ce-419a-9755-e1123dd21060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3d0da0-68ce-419a-9755-e1123dd21060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cd8d8f-2432-42fa-a169-58c10daa891e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:19 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume 709607cd-3c91-4caa-a5e1-9bf13e5848a0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0', 'volume_size': 1, 'image_id': 'cd0698d5-d756-487e-9386-d1abaf6fc7e1', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--898536221', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e18f3e8f057e41ba950380582047a36f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0698d5-d756-487e-9386-d1abaf6fc7e1', 'created_at': datetime.datetime(2025, 9, 18, 20, 17, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 20, 17, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0698d5-d756-487e-9386-d1abaf6fc7e1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f90546ba440>}
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Cloning 709607cd-3c91-4caa-a5e1-9bf13e5848a0 from image cd0698d5-d756-487e-9386-d1abaf6fc7e1  at location (None, None). {{(pid=83342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-9f8fa8ab-9cd2-4bf8-b4b8-69e06150fff7 req-115d99be-9f52-4dcc-ac72-ace2e7434fa3 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.431s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b961fe3-ca39-4f30-b5ef-0e7620b3bd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a480ac5-5f77-47e5-9708-2e9421c76e7e', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf97f3a-ee09-47d3-a0cb-11c8ef6cc32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:19 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-6c7afb9a-5a1c-4765-8ba1-95ff1fae1a16 tempest-TestInstancesWithCinderVolumes-807846878 None] Created volume successfully.
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3025623c-98ae-4a60-ba6a-a52229e2443f]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-9f8fa8ab-9cd2-4bf8-b4b8-69e06150fff7 req-115d99be-9f52-4dcc-ac72-ace2e7434fa3 tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:19 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume volume-6a480ac5-5f77-47e5-9708-2e9421c76e7e (6a480ac5-5f77-47e5-9708-2e9421c76e7e): created successfully
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf97f3a-ee09-47d3-a0cb-11c8ef6cc32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Flow 'volume_create_manager' (b6a2bcfb-a661-4f18-9896-c6d77f38b3ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:17:19 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-eff0c0b7-93c6-4a24-83fa-233ac82e92c1 tempest-TestInstancesWithCinderVolumes-807846878 None] Created volume successfully.
Sep 18 22:17:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-9f8fa8ab-9cd2-4bf8-b4b8-69e06150fff7 req-115d99be-9f52-4dcc-ac72-ace2e7434fa3 tempest-AttachVolumeNegativeTest-1277586577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d" returned: 0 in 0.591s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-9f8fa8ab-9cd2-4bf8-b4b8-69e06150fff7 req-115d99be-9f52-4dcc-ac72-ace2e7434fa3 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.662s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:17:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-9f8fa8ab-9cd2-4bf8-b4b8-69e06150fff7 req-115d99be-9f52-4dcc-ac72-ace2e7434fa3 tempest-AttachVolumeNegativeTest-1277586577 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be5445a0-30a9-4c01-84de-4c5d81fc7d1e', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:17:20 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-9f8fa8ab-9cd2-4bf8-b4b8-69e06150fff7 req-115d99be-9f52-4dcc-ac72-ace2e7434fa3 tempest-AttachVolumeNegativeTest-1277586577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:17:20 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-9f8fa8ab-9cd2-4bf8-b4b8-69e06150fff7 req-115d99be-9f52-4dcc-ac72-ace2e7434fa3 tempest-AttachVolumeNegativeTest-1277586577 None] attachment_update completed successfully.
Sep 18 22:17:21 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd0698d5-d756-487e-9386-d1abaf6fc7e1_nbir8tbrdevstack@QuobyteHD, size 20.69 MB, duration 2.29 sec {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 22:17:21 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Image download 20.69 MB at 9.04 MB/s
Sep 18 22:17:21 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42480bf-099a-417c-84ee-217339252547]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:17:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0698d5-d756-487e-9386-d1abaf6fc7e1_nbir8tbrdevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:22 devstack sudo[92031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0698d5-d756-487e-9386-d1abaf6fc7e1_nbir8tbrdevstack@QuobyteHD
Sep 18 22:17:22 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:17:23 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root
Sep 18 22:17:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0698d5-d756-487e-9386-d1abaf6fc7e1_nbir8tbrdevstack@QuobyteHD" returned: 0 in 2.233s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:24 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Temporary image cd0698d5-d756-487e-9386-d1abaf6fc7e1 is fetched for user 5ed9ac6a95c948fa8ee33bb94cc1e180. {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 22:17:24 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc4a4cd-856f-4afd-bd5b-694dd8b84449]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:17:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0698d5-d756-487e-9386-d1abaf6fc7e1_nbir8tbrdevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:24 devstack sudo[92355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0698d5-d756-487e-9386-d1abaf6fc7e1_nbir8tbrdevstack@QuobyteHD
Sep 18 22:17:24 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:17:26 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root
Sep 18 22:17:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0698d5-d756-487e-9386-d1abaf6fc7e1_nbir8tbrdevstack@QuobyteHD" returned: 0 in 2.237s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:17:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:17:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-835187864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709607cd-3c91-4caa-a5e1-9bf13e5848a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18f3e8f057e41ba950380582047a36f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:17:17Z,use_quota=True,user_id='5ed9ac6a95c948fa8ee33bb94cc1e180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bff8d87-ae06-4047-9ed9-170759ecae92),volume_type_id=7bff8d87-ae06-4047-9ed9-170759ecae92)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:17:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Creating volume 709607cd-3c91-4caa-a5e1-9bf13e5848a0 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:17:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:17:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:17:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:17:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:17:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:17:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:17:26 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:17:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:26 devstack quobyte-client[83360]: System call of process 92360 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:17:26 devstack quobyte-client[83360]: System call of process 92360 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:17:26 devstack quobyte-client[83360]: System call of process 92360 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:17:26 devstack quobyte-client[83360]: System call of process 92360 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:17:26 devstack quobyte-client[83360]: System call of process 92360 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:17:26 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=56, name=volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:17:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0 1073741824" returned: 0 in 0.406s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0" returned: 0 in 0.102s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] <== create_volume: return (603ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:17:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.630s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:17:27 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Attempting download of cd0698d5-d756-487e-9386-d1abaf6fc7e1 ((None, None)) to volume 709607cd-3c91-4caa-a5e1-9bf13e5848a0. {{(pid=83342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 22:17:27 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[640aa775-b6d3-4734-ad26-29d28afe5d09]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:17:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0698d5-d756-487e-9386-d1abaf6fc7e1_68hjtlro {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd0698d5-d756-487e-9386-d1abaf6fc7e1_68hjtlro" returned: 0 in 0.519s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0698d5-d756-487e-9386-d1abaf6fc7e1_68hjtlro {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0698d5-d756-487e-9386-d1abaf6fc7e1_68hjtlro" returned: 1 in 0.529s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd0698d5-d756-487e-9386-d1abaf6fc7e1_68hjtlro' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:17:28 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb99e11-bdda-4366-abf5-d217f80f349f]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:17:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0698d5-d756-487e-9386-d1abaf6fc7e1_nbir8tbrdevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cd0698d5-d756-487e-9386-d1abaf6fc7e1_nbir8tbrdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:29 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] cd0698d5-d756-487e-9386-d1abaf6fc7e1 was qcow2, converting to raw {{(pid=83342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 22:17:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0698d5-d756-487e-9386-d1abaf6fc7e1_nbir8tbrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:29 devstack quobyte-client[83360]: System call of process 92387 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:17:29 devstack quobyte-client[83360]: System call of process 92387 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:17:29 devstack quobyte-client[83360]: System call of process 92387 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:17:29 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=56, name=volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:17:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cd0698d5-d756-487e-9386-d1abaf6fc7e1_nbir8tbrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0" returned: 0 in 0.989s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:30 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd0698d5-d756-487e-9386-d1abaf6fc7e1_nbir8tbrdevstack@QuobyteHD, size 112.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0 {{(pid=83342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 22:17:30 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Converted 112.00 MB image at 110.52 MB/s
Sep 18 22:17:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:30 devstack quobyte-client[83360]: System call of process 92397 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:17:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0 1G" returned: 0 in 0.152s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:30 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed665c9-e2d0-4553-b2be-d5b56d95b58a]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:17:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:31 devstack quobyte-client[83360]: System call of process 92401 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:17:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0" returned: 0 in 0.397s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0" returned: 1 in 0.415s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:17:31 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Downloaded image cd0698d5-d756-487e-9386-d1abaf6fc7e1 ((None, None)) to volume 709607cd-3c91-4caa-a5e1-9bf13e5848a0 successfully. {{(pid=83342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 22:17:31 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Temporary image cd0698d5-d756-487e-9386-d1abaf6fc7e1 for user 5ed9ac6a95c948fa8ee33bb94cc1e180 is deleted. {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 22:17:31 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Marking volume 709607cd-3c91-4caa-a5e1-9bf13e5848a0 as bootable. {{(pid=83342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 22:17:31 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Copying metadata from image cd0698d5-d756-487e-9386-d1abaf6fc7e1 to 709607cd-3c91-4caa-a5e1-9bf13e5848a0. {{(pid=83342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 22:17:31 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Creating volume glance metadata for volume 709607cd-3c91-4caa-a5e1-9bf13e5848a0 backed by image cd0698d5-d756-487e-9386-d1abaf6fc7e1 with: {'image_id': 'cd0698d5-d756-487e-9386-d1abaf6fc7e1', 'image_name': 'tempest-scenario-img--898536221', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 22:17:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cd8d8f-2432-42fa-a169-58c10daa891e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0', 'volume_size': 1, 'image_id': 'cd0698d5-d756-487e-9386-d1abaf6fc7e1', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--898536221', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e18f3e8f057e41ba950380582047a36f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cd0698d5-d756-487e-9386-d1abaf6fc7e1', 'created_at': datetime.datetime(2025, 9, 18, 20, 17, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 20, 17, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd0698d5-d756-487e-9386-d1abaf6fc7e1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f90546ba440>}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5572244a-bb02-4d1d-a806-29d4c459a9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:32 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0 (709607cd-3c91-4caa-a5e1-9bf13e5848a0): created successfully
Sep 18 22:17:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5572244a-bb02-4d1d-a806-29d4c459a9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Flow 'volume_create_manager' (50b8bd8a-c4d0-4937-9c4d-0666832cad6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:17:32 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-f50d388d-9b06-4a86-a9ca-af62f3726308 tempest-TestInstancesWithCinderVolumes-807846878 None] Created volume successfully.
Sep 18 22:17:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-4b355ed2-e346-48c8-b94b-07a554785c49 req-12137915-67fa-4866-ad60-4fba7ce1bfb7 tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:17:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-4b355ed2-e346-48c8-b94b-07a554785c49 req-12137915-67fa-4866-ad60-4fba7ce1bfb7 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:17:41 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d2237c-b06c-45ee-a04b-c9a2cd497f34]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:17:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-4b355ed2-e346-48c8-b94b-07a554785c49 req-12137915-67fa-4866-ad60-4fba7ce1bfb7 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:42 devstack quobyte-client[83360]: System call of process 92462 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:17:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-4b355ed2-e346-48c8-b94b-07a554785c49 req-12137915-67fa-4866-ad60-4fba7ce1bfb7 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0" returned: 0 in 0.437s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:42 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:DELETE=2,cinder:INSERT=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:17:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-4b355ed2-e346-48c8-b94b-07a554785c49 req-12137915-67fa-4866-ad60-4fba7ce1bfb7 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-4b355ed2-e346-48c8-b94b-07a554785c49 req-12137915-67fa-4866-ad60-4fba7ce1bfb7 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0" returned: 1 in 0.494s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-4b355ed2-e346-48c8-b94b-07a554785c49 req-12137915-67fa-4866-ad60-4fba7ce1bfb7 tempest-TestInstancesWithCinderVolumes-807846878 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:17:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-4b355ed2-e346-48c8-b94b-07a554785c49 req-12137915-67fa-4866-ad60-4fba7ce1bfb7 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.222s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:17:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-4b355ed2-e346-48c8-b94b-07a554785c49 req-12137915-67fa-4866-ad60-4fba7ce1bfb7 tempest-TestInstancesWithCinderVolumes-807846878 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'deaf3d0e-0684-497d-b109-3b68a6b77400', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:17:43 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-4b355ed2-e346-48c8-b94b-07a554785c49 req-12137915-67fa-4866-ad60-4fba7ce1bfb7 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:17:43 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-4b355ed2-e346-48c8-b94b-07a554785c49 req-12137915-67fa-4866-ad60-4fba7ce1bfb7 tempest-TestInstancesWithCinderVolumes-807846878 None] attachment_update completed successfully.
Sep 18 22:17:46 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:17:46 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:17:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Flow 'volume_create_manager' (f6d25131-0b27-4e5a-92d4-b203a5d2f739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:17:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b1eb78-fdfd-4889-8152-76d1ceee1a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:17:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:17:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:17:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:17:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:17:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:17:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b1eb78-fdfd-4889-8152-76d1ceee1a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-507534137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa29d2c-32b6-49de-b330-73a4de529d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e09e144137477592f58df68593263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:17:46Z,use_quota=True,user_id='cb6b6b3a909b44afa722627c3adf111e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a63412-fbcf-44f6-ab11-7cc6111ada6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a63412-fbcf-44f6-ab11-7cc6111ada6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66535f31-cc60-4c42-a19c-525e20aa9513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66535f31-cc60-4c42-a19c-525e20aa9513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aa29d2c-32b6-49de-b330-73a4de529d5e', 'volume_name': 'volume-8aa29d2c-32b6-49de-b330-73a4de529d5e', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4893cf25-32d8-4756-b588-e2cf47f9d04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4893cf25-32d8-4756-b588-e2cf47f9d04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5fae32-2d97-4819-b87d-9d815a03dfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:47 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Volume 8aa29d2c-32b6-49de-b330-73a4de529d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aa29d2c-32b6-49de-b330-73a4de529d5e', 'volume_size': 1}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-507534137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa29d2c-32b6-49de-b330-73a4de529d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e09e144137477592f58df68593263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:17:46Z,use_quota=True,user_id='cb6b6b3a909b44afa722627c3adf111e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Creating volume 8aa29d2c-32b6-49de-b330-73a4de529d5e {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:17:47 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8aa29d2c-32b6-49de-b330-73a4de529d5e 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.882s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:17:47 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=57, name=volume-8aa29d2c-32b6-49de-b330-73a4de529d5e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:17:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8aa29d2c-32b6-49de-b330-73a4de529d5e 1073741824" returned: 0 in 0.535s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8aa29d2c-32b6-49de-b330-73a4de529d5e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8aa29d2c-32b6-49de-b330-73a4de529d5e" returned: 0 in 0.166s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] <== create_volume: return (826ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:17:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:17:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5fae32-2d97-4819-b87d-9d815a03dfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aa29d2c-32b6-49de-b330-73a4de529d5e', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b52f4c-93e7-4cbf-87e7-c9a08269c61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:17:48 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Volume volume-8aa29d2c-32b6-49de-b330-73a4de529d5e (8aa29d2c-32b6-49de-b330-73a4de529d5e): created successfully
Sep 18 22:17:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b52f4c-93e7-4cbf-87e7-c9a08269c61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:17:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Flow 'volume_create_manager' (f6d25131-0b27-4e5a-92d4-b203a5d2f739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:17:48 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-6c96da37-d41e-450e-b1b2-2bf86f47360d tempest-AttachVolumeTestJSON-1086341451 None] Created volume successfully.
Sep 18 22:17:49 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-76985791-27c9-4684-8b15-9d2f99dbc472 req-b429f4f2-b92c-425a-994b-efc58454cf3b tempest-AttachVolumeNegativeTest-1277586577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:17:49 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-76985791-27c9-4684-8b15-9d2f99dbc472 req-b429f4f2-b92c-425a-994b-efc58454cf3b tempest-AttachVolumeNegativeTest-1277586577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:17:49 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-76985791-27c9-4684-8b15-9d2f99dbc472 req-b429f4f2-b92c-425a-994b-efc58454cf3b tempest-AttachVolumeNegativeTest-1277586577 None] Terminate volume connection completed successfully.
Sep 18 22:17:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-76985791-27c9-4684-8b15-9d2f99dbc472 req-b429f4f2-b92c-425a-994b-efc58454cf3b tempest-AttachVolumeNegativeTest-1277586577 None] Deleting attachment be5445a0-30a9-4c01-84de-4c5d81fc7d1e. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:17:54 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-4b355ed2-e346-48c8-b94b-07a554785c49 req-140778a4-64f7-4532-908b-6aa9ea585568 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:17:54 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-4b355ed2-e346-48c8-b94b-07a554785c49 req-140778a4-64f7-4532-908b-6aa9ea585568 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:17:54 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-4b355ed2-e346-48c8-b94b-07a554785c49 req-140778a4-64f7-4532-908b-6aa9ea585568 tempest-TestInstancesWithCinderVolumes-807846878 None] Terminate volume connection completed successfully.
Sep 18 22:17:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-4b355ed2-e346-48c8-b94b-07a554785c49 req-140778a4-64f7-4532-908b-6aa9ea585568 tempest-TestInstancesWithCinderVolumes-807846878 None] Deleting attachment deaf3d0e-0684-497d-b109-3b68a6b77400. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:17:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-a4a845a6-aabd-448a-8c9f-59298b1b69cf req-19e1fa01-5ee4-4a9b-8bdd-d14ebb0b5da6 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:17:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-a4a845a6-aabd-448a-8c9f-59298b1b69cf req-19e1fa01-5ee4-4a9b-8bdd-d14ebb0b5da6 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:17:55 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[48986c37-3de5-4966-8792-d8e0b65ad6e3]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:17:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-a4a845a6-aabd-448a-8c9f-59298b1b69cf req-19e1fa01-5ee4-4a9b-8bdd-d14ebb0b5da6 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8aa29d2c-32b6-49de-b330-73a4de529d5e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:17:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-a4a845a6-aabd-448a-8c9f-59298b1b69cf req-19e1fa01-5ee4-4a9b-8bdd-d14ebb0b5da6 tempest-AttachVolumeTestJSON-1086341451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8aa29d2c-32b6-49de-b330-73a4de529d5e" returned: 0 in 0.677s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:17:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-a4a845a6-aabd-448a-8c9f-59298b1b69cf req-19e1fa01-5ee4-4a9b-8bdd-d14ebb0b5da6 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.776s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:17:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-a4a845a6-aabd-448a-8c9f-59298b1b69cf req-19e1fa01-5ee4-4a9b-8bdd-d14ebb0b5da6 tempest-AttachVolumeTestJSON-1086341451 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-8aa29d2c-32b6-49de-b330-73a4de529d5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32500bde-f5e5-49fd-839f-b02f026c59ed', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:17:57 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-a4a845a6-aabd-448a-8c9f-59298b1b69cf req-19e1fa01-5ee4-4a9b-8bdd-d14ebb0b5da6 tempest-AttachVolumeTestJSON-1086341451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:17:57 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-a4a845a6-aabd-448a-8c9f-59298b1b69cf req-19e1fa01-5ee4-4a9b-8bdd-d14ebb0b5da6 tempest-AttachVolumeTestJSON-1086341451 None] attachment_update completed successfully.
Sep 18 22:18:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "cinder-94884fd6-e3a9-4af3-87df-b7258e0e9e6d-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:18:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Lock "cinder-94884fd6-e3a9-4af3-87df-b7258e0e9e6d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:18:03 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:18:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "cinder-quobyte-94884fd6-e3a9-4af3-87df-b7258e0e9e6d" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:18:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Lock "cinder-quobyte-94884fd6-e3a9-4af3-87df-b7258e0e9e6d" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:18:03 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3fca93-3b63-4270-9c77-7e73bbf6e54c]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:18:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d" returned: 0 in 0.461s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-94884fd6-e3a9-4af3-87df-b7258e0e9e6d" returned: 0 in 0.134s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Lock "cinder-quobyte-94884fd6-e3a9-4af3-87df-b7258e0e9e6d" released by "delete_volume" :: held 0.799s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:18:04 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Created reservations ['9356bcec-2d80-48f0-934b-963d38ac16eb', 'aa43effc-7073-476c-9ba8-388180d8ffc1', '1f715549-951c-41a9-a5c7-2f9b62a8ab28', '636220ed-b4fc-4e79-987a-5faa278a2ebf'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:18:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:18:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:18:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:18:05 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:18:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:18:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.122s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:05 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:18:05 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Deleted volume successfully.
Sep 18 22:18:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "cinder-709607cd-3c91-4caa-a5e1-9bf13e5848a0-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:18:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "cinder-709607cd-3c91-4caa-a5e1-9bf13e5848a0-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:18:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-003edf05-2420-49e6-9e2c-eaed896629ef tempest-AttachVolumeNegativeTest-1277586577 None] Lock "cinder-94884fd6-e3a9-4af3-87df-b7258e0e9e6d-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:18:05 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:18:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "cinder-quobyte-709607cd-3c91-4caa-a5e1-9bf13e5848a0" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:18:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "cinder-quobyte-709607cd-3c91-4caa-a5e1-9bf13e5848a0" acquired by "delete_volume" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:18:05 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee6672d-bfdf-4349-8125-1827e274f9a2]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:18:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:06 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "cinder-e7509241-62ff-4ac7-abf6-970a60e669d3-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:18:06 devstack quobyte-client[83360]: System call of process 92978 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:18:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0" returned: 0 in 0.578s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:06 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "cinder-e7509241-62ff-4ac7-abf6-970a60e669d3-delete_volume" acquired by "delete_volume" :: waited 0.771s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:18:07 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=25,cinder:SELECT=39,cinder:DELETE=4,cinder:INSERT=9 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:18:07 devstack quobyte-client[83360]: System call of process 92990 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:18:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0" returned: 1 in 1.596s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:18:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:08 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:18:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "cinder-quobyte-e7509241-62ff-4ac7-abf6-970a60e669d3" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:18:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-709607cd-3c91-4caa-a5e1-9bf13e5848a0" returned: 0 in 0.865s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "cinder-quobyte-709607cd-3c91-4caa-a5e1-9bf13e5848a0" released by "delete_volume" :: held 3.370s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:18:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "cinder-quobyte-e7509241-62ff-4ac7-abf6-970a60e669d3" acquired by "delete_volume" :: waited 0.380s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:18:09 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3df4ce-d983-4444-a280-86b727fa5a37]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:18:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e7509241-62ff-4ac7-abf6-970a60e669d3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:09 devstack cinder-volume[83342]: WARNING cinder.quota [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1845620191-1555697263 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1845620191-1555697263, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:18:09 devstack cinder-volume[83342]: WARNING cinder.quota [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1845620191-1555697263 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1845620191-1555697263, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:18:10 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Created reservations ['cd3a0afb-3b90-401e-a24c-2bbbd6cd2692', 'a9d60a04-30fb-47ce-b738-f2def1491eee', '7cd1f638-fafd-4c26-9d82-64c2aefc87d4', '08b93cbe-de3e-41e9-8602-714b130d577e'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:18:10 devstack quobyte-client[83360]: System call of process 93074 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:18:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e7509241-62ff-4ac7-abf6-970a60e669d3" returned: 0 in 1.239s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e7509241-62ff-4ac7-abf6-970a60e669d3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e7509241-62ff-4ac7-abf6-970a60e669d3" returned: 0 in 0.379s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:10 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "cinder-quobyte-e7509241-62ff-4ac7-abf6-970a60e669d3" released by "delete_volume" :: held 1.922s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "cinder-6a480ac5-5f77-47e5-9708-2e9421c76e7e-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Created reservations ['439f62ae-18a5-47b4-abef-d13dce9ae0af', 'e3bcdb75-a220-47d3-8802-103919c2f310', '1c9e8bda-170d-4d59-a62a-e1b6e8f3d1cb', '4ff3f92f-5c9b-4d5c-8ac6-42922480f98e'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.616s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:18:11 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Deleted volume successfully.
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0247dd41-2663-4b62-8f78-1da276e01b1e tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "cinder-709607cd-3c91-4caa-a5e1-9bf13e5848a0-delete_volume" released by "delete_volume" :: held 6.429s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "cinder-6a480ac5-5f77-47e5-9708-2e9421c76e7e-delete_volume" acquired by "delete_volume" :: waited 0.280s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:18:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.454s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:12 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:18:12 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Deleted volume successfully.
Sep 18 22:18:12 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:18:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "cinder-quobyte-6a480ac5-5f77-47e5-9708-2e9421c76e7e" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:18:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "cinder-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:18:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-19aea9ae-f5b9-4d87-9f6a-8df630ef68c4 tempest-AttachVolumeNegativeTest-1277586577 None] Lock "cinder-e7509241-62ff-4ac7-abf6-970a60e669d3-delete_volume" released by "delete_volume" :: held 5.899s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:18:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Lock "cinder-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:18:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "cinder-quobyte-6a480ac5-5f77-47e5-9708-2e9421c76e7e" acquired by "delete_volume" :: waited 0.144s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:18:12 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e7340-0b91-4d58-b630-aa31a0d1260e]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:18:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a480ac5-5f77-47e5-9708-2e9421c76e7e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:13 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:18:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "cinder-quobyte-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:18:13 devstack quobyte-client[83360]: System call of process 93112 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:18:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a480ac5-5f77-47e5-9708-2e9421c76e7e" returned: 0 in 0.851s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a480ac5-5f77-47e5-9708-2e9421c76e7e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Lock "cinder-quobyte-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99" acquired by "delete_volume" :: waited 0.288s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:18:13 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[50681376-a26f-4026-b3a8-43dae031135e]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:18:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a480ac5-5f77-47e5-9708-2e9421c76e7e" returned: 0 in 0.295s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "cinder-quobyte-6a480ac5-5f77-47e5-9708-2e9421c76e7e" released by "delete_volume" :: held 1.331s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:18:14 devstack cinder-volume[83342]: WARNING cinder.quota [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-537090277-1814385476 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-537090277-1814385476, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:18:14 devstack cinder-volume[83342]: WARNING cinder.quota [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-537090277-1814385476 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-537090277-1814385476, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:18:14 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Created reservations ['4ae0cfba-f261-45a9-9505-9056c200925b', 'cc5d5d6b-14f4-4607-825c-07ab76de48f5', 'c59a8253-1b30-4690-b75d-013edb213887', 'a46f9b4c-67a5-4d4b-ad0d-c8c414df005c'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:18:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99" returned: 0 in 0.567s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:18:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:18:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:18:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:18:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:18:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "cinder-4d744114-00f2-49ed-8b4b-e7b1cc5939fc-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99" returned: 0 in 0.609s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.405s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "cinder-4d744114-00f2-49ed-8b4b-e7b1cc5939fc-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Lock "cinder-quobyte-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99" released by "delete_volume" :: held 1.457s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:18:15 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Deleted volume successfully.
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Created reservations ['51950272-0193-4456-89a5-cafb90f4cf18', 'a094a940-ce94-4b20-aae6-a151f7c5e11a', '2159873b-7261-4dd4-8e86-bcc78f086f79', '44b6975e-6662-4b8c-84d8-c4b9d23c324d'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6efe05bc-6158-4a37-9343-6ff53d108c46 tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "cinder-6a480ac5-5f77-47e5-9708-2e9421c76e7e-delete_volume" released by "delete_volume" :: held 3.625s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:18:15 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "cinder-quobyte-4d744114-00f2-49ed-8b4b-e7b1cc5939fc" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "cinder-quobyte-4d744114-00f2-49ed-8b4b-e7b1cc5939fc" acquired by "delete_volume" :: waited 0.026s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c23d35-fc02-4312-8be5-5691bcb3226f]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4d744114-00f2-49ed-8b4b-e7b1cc5939fc {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.102s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:15 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:18:16 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Deleted volume successfully.
Sep 18 22:18:16 devstack quobyte-client[83360]: System call of process 93129 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:18:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d7acb206-7956-4d74-a7fb-b0f604144cca tempest-AttachVolumeNegativeTest-1277586577 None] Lock "cinder-d7f8cc8f-21d9-4bd7-9858-dda7d23f6e99-delete_volume" released by "delete_volume" :: held 3.426s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:18:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4d744114-00f2-49ed-8b4b-e7b1cc5939fc" returned: 0 in 0.663s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4d744114-00f2-49ed-8b4b-e7b1cc5939fc {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4d744114-00f2-49ed-8b4b-e7b1cc5939fc" returned: 0 in 0.122s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "cinder-quobyte-4d744114-00f2-49ed-8b4b-e7b1cc5939fc" released by "delete_volume" :: held 1.026s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:18:16 devstack cinder-volume[83342]: WARNING cinder.quota [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-362988181-81383779 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-362988181-81383779, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:18:16 devstack cinder-volume[83342]: WARNING cinder.quota [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-362988181-81383779 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-362988181-81383779, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:18:17 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Created reservations ['bf31d494-dd85-4b41-845d-6fb8126c84a6', '2a42e5c1-e352-4f9e-8027-c6a3bc40b6f9', 'c5e65ae0-c6f2-4431-ae55-31cec5ff3c44', '2777fe1c-5cb9-4397-8ec1-755380393688'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:18:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:18:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:18:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:18:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:18:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:18:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.108s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:17 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:18:17 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Deleted volume successfully.
Sep 18 22:18:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2b7c876f-dd1a-4944-8601-8e3b7dd1faad tempest-TestInstancesWithCinderVolumes-807846878 None] Lock "cinder-4d744114-00f2-49ed-8b4b-e7b1cc5939fc-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:18:27 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=25,cinder:INSERT=11,cinder:UPDATE=48,cinder:DELETE=3 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:18:27 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=42,cinder:UPDATE=44,cinder:INSERT=11,cinder:DELETE=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:18:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6d83944e-1d7b-420d-b68b-0f4d57c15f88 tempest-BackendsCapabilitiesAdminTestsJSON-1724594343 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144821166992, 'free_capacity_gb': 924.9144821166992, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83342) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 18 22:18:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b13aa67-064d-4cf8-9147-e27cd9c38399 tempest-BackendsCapabilitiesAdminTestsJSON-1724594343 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9144821166992, 'free_capacity_gb': 924.9144821166992, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83342) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 18 22:18:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:18:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:18:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:18:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:18:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:18:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:18:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.293s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:18:50 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-02c3eebe-9638-4cef-85b1-3a5d6a37f1e5 tempest-GroupsV320Test-670169405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:18:50 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-02c3eebe-9638-4cef-85b1-3a5d6a37f1e5 tempest-GroupsV320Test-670169405 None] Group tempest-GroupsV320Test-Group-1084386894: creating
Sep 18 22:18:50 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-02c3eebe-9638-4cef-85b1-3a5d6a37f1e5 tempest-GroupsV320Test-670169405 None] Group tempest-GroupsV320Test-Group-1084386894: created successfully
Sep 18 22:18:50 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-02c3eebe-9638-4cef-85b1-3a5d6a37f1e5 tempest-GroupsV320Test-670169405 None] Create group completed successfully.
Sep 18 22:18:52 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-3f1c8024-00b4-4c97-a7e5-f678a7e5c71e tempest-GroupsV320Test-670169405 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:18:52 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-3f1c8024-00b4-4c97-a7e5-f678a7e5c71e tempest-GroupsV320Test-670169405 None] Created reservations ['347e6897-e40d-46a1-8c1c-32d07a4ff54d'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:18:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3f1c8024-00b4-4c97-a7e5-f678a7e5c71e tempest-GroupsV320Test-670169405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:18:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3f1c8024-00b4-4c97-a7e5-f678a7e5c71e tempest-GroupsV320Test-670169405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:18:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c8024-00b4-4c97-a7e5-f678a7e5c71e tempest-GroupsV320Test-670169405 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:18:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c8024-00b4-4c97-a7e5-f678a7e5c71e tempest-GroupsV320Test-670169405 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:18:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3f1c8024-00b4-4c97-a7e5-f678a7e5c71e tempest-GroupsV320Test-670169405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:18:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3f1c8024-00b4-4c97-a7e5-f678a7e5c71e tempest-GroupsV320Test-670169405 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:18:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3f1c8024-00b4-4c97-a7e5-f678a7e5c71e tempest-GroupsV320Test-670169405 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.314s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:18:52 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-3f1c8024-00b4-4c97-a7e5-f678a7e5c71e tempest-GroupsV320Test-670169405 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:18:52 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-3f1c8024-00b4-4c97-a7e5-f678a7e5c71e tempest-GroupsV320Test-670169405 None] Delete group completed successfully.
Sep 18 22:19:02 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:19:02 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:19:14 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Flow 'volume_create_manager' (65b9cebc-98b8-4a63-88d0-283ac5c110d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423682de-6ffc-4193-8545-9a3249795197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423682de-6ffc-4193-8545-9a3249795197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1579291393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172ea444c8fc4ec4a9b900526ee327b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:19:14Z,use_quota=True,user_id='584f22b98c1740689fa0f026a66f5483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf1444d-a889-48e7-b817-e40a7fd9eba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf1444d-a889-48e7-b817-e40a7fd9eba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02610b63-1c42-4900-9273-b3a31ce1ef42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02610b63-1c42-4900-9273-b3a31ce1ef42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d', 'volume_name': 'volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979c2412-76f2-45cb-8215-21012d3013e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (979c2412-76f2-45cb-8215-21012d3013e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9e30b5-418b-46a4-b331-40cce698f64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:19:14 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Volume e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d', 'volume_size': 1}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1579291393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='172ea444c8fc4ec4a9b900526ee327b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:19:14Z,use_quota=True,user_id='584f22b98c1740689fa0f026a66f5483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Creating volume e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:19:14 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:19:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:14 devstack quobyte-client[83360]: System call of process 93733 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:14 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=58, name=volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:19:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d 1073741824" returned: 0 in 0.484s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" returned: 0 in 0.198s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] <== create_volume: return (872ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:19:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:19:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9e30b5-418b-46a4-b331-40cce698f64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:19:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f5edf3-eaaa-42e8-a2da-1da087ee949a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:19:15 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Volume volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d (e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d): created successfully
Sep 18 22:19:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f5edf3-eaaa-42e8-a2da-1da087ee949a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:19:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Flow 'volume_create_manager' (65b9cebc-98b8-4a63-88d0-283ac5c110d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:19:15 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-60375400-dd92-432d-a009-af15dfe25e58 tempest-SnapshotsActionsTest-1679667551 None] Created volume successfully.
Sep 18 22:19:16 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:19:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:19:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:19:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] Creating offline snapshot 7a139db7-bb08-47ab-9f48-57eef32f06b9 of volume e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:19:16 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[319d2410-0345-46e8-af6f-a3550fcf9e8d]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" returned: 0 in 0.613s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:17 devstack quobyte-client[83360]: System call of process 93741 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:17 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=59, name=volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:19:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 1G" returned: 0 in 0.320s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:17 devstack quobyte-client[83360]: System call of process 93744 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] CMD "qemu-img rebase -u -b volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9" returned: 0 in 0.204s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:19:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9" returned: 0 in 0.155s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:19:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9" returned: 0 in 0.285s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.info" returned: 0 in 0.197s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:19:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.info" returned: 0 in 0.126s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:19:19 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-9089a18a-fa82-4682-b1d2-f4eae38ce80c tempest-SnapshotsActionsTest-1679667551 None] Create snapshot completed successfully
Sep 18 22:19:20 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:19:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:19:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:19:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] Creating offline snapshot 2f20e2ac-1464-4459-abb6-ea2693d99086 of volume e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:19:20 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3ee9eb-5237-4f8c-af37-0f5b1b21c838]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:21 devstack quobyte-client[83360]: System call of process 93761 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9" returned: 0 in 0.531s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:19:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:21 devstack quobyte-client[83360]: System call of process 93765 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:21 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=61, name=volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:19:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086 1G" returned: 0 in 0.343s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] CMD "qemu-img rebase -u -b volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086" returned: 0 in 0.183s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:19:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086" returned: 0 in 0.099s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:19:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086" returned: 0 in 0.188s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.690s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:19:22 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c619bf5a-3b5b-4777-a02b-09017aa5e947 tempest-SnapshotsActionsTest-1679667551 None] Create snapshot completed successfully
Sep 18 22:19:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Acquiring lock "cinder-2f20e2ac-1464-4459-abb6-ea2693d99086-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-2f20e2ac-1464-4459-abb6-ea2693d99086-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:22 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:19:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Acquiring lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Acquiring lock "cinder-quobyte-2f20e2ac-1464-4459-abb6-ea2693d99086" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-2f20e2ac-1464-4459-abb6-ea2693d99086" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Deleting offline snapshot 2f20e2ac-1464-4459-abb6-ea2693d99086 of volume e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:19:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] snapshot_file for this snap is: volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:19:22 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4604e4c0-50bc-4c92-bfff-8b885176e704]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:23 devstack quobyte-client[83360]: System call of process 93779 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086" returned: 0 in 0.464s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:19:23 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc029b8-19f8-49b2-a247-1bd0421b045e]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9" returned: 0 in 0.529s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:19:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086" returned: 0 in 0.365s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.2f20e2ac-1464-4459-abb6-ea2693d99086" returned: 0 in 0.152s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:24 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-2f20e2ac-1464-4459-abb6-ea2693d99086" released by "_delete_snapshot" :: held 1.892s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:24 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" released by "delete_snapshot" :: held 1.935s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:25 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Created reservations ['a3178b5d-d145-4762-adb6-1e0b9c49d132', '6d94d617-f753-4558-8ae3-4e50bae033ff', '082aa15f-0688-4cf6-b290-bc2237f28f4b', '758dcd81-cc40-42cf-b93b-fd2275bcab89'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:19:25 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Delete snapshot completed successfully.
Sep 18 22:19:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e36b9760-8df3-4912-9b52-7d08360bbd8b tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-2f20e2ac-1464-4459-abb6-ea2693d99086-delete_snapshot" released by "delete_snapshot" :: held 2.909s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:27 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:19:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:19:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:19:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] Creating offline snapshot 44fe35af-374f-435f-a576-2b2976892cff of volume e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:19:27 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c8e0d4-335e-4629-95a9-af1225e7fe26]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9" returned: 0 in 0.931s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:28 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:19:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:28 devstack quobyte-client[83360]: System call of process 93803 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:28 devstack quobyte-client[83360]: System call of process 93803 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:28 devstack quobyte-client[83360]: System call of process 93803 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:28 devstack quobyte-client[83360]: System call of process 93803 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:28 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=62, name=volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:19:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff 1G" returned: 0 in 0.520s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:29 devstack quobyte-client[83360]: System call of process 93813 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:29 devstack quobyte-client[83360]: System call of process 93813 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:29 devstack quobyte-client[83360]: System call of process 93813 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] CMD "qemu-img rebase -u -b volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff" returned: 0 in 0.489s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:19:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff" returned: 0 in 0.244s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:19:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff" returned: 0 in 0.188s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.098s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:19:30 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-4e83385a-7240-4577-b842-9a11a5c47304 tempest-SnapshotsActionsTest-1679667551 None] Create snapshot completed successfully
Sep 18 22:19:31 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Acquiring lock "cinder-44fe35af-374f-435f-a576-2b2976892cff-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:31 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-44fe35af-374f-435f-a576-2b2976892cff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:31 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:19:31 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Acquiring lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:31 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:31 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Acquiring lock "cinder-quobyte-44fe35af-374f-435f-a576-2b2976892cff" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:31 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-44fe35af-374f-435f-a576-2b2976892cff" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Deleting offline snapshot 44fe35af-374f-435f-a576-2b2976892cff of volume e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:19:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] snapshot_file for this snap is: volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:19:31 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de58bd0-f866-40c5-a675-19387e35e33f]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:31 devstack quobyte-client[83360]: System call of process 93824 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:31 devstack quobyte-client[83360]: System call of process 93824 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff" returned: 0 in 0.552s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:32 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:19:32 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[22414b76-f351-47f7-a0e2-a3093771c6f7]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:32 devstack quobyte-client[83360]: System call of process 93827 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9" returned: 0 in 0.649s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:32 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:19:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff" returned: 0 in 0.220s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.44fe35af-374f-435f-a576-2b2976892cff" returned: 0 in 0.132s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-44fe35af-374f-435f-a576-2b2976892cff" released by "_delete_snapshot" :: held 1.983s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" released by "delete_snapshot" :: held 2.002s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:33 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Created reservations ['03a77ad1-c347-4997-8a6b-1dae70c77e16', '0b85fe1a-3c92-44aa-9097-a0baf3e2f7f5', 'f3dadd23-b7af-4698-afaa-3e0f7eaee235', 'f491da7e-fd17-4e28-93ab-5542544d374e'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:19:33 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Delete snapshot completed successfully.
Sep 18 22:19:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0a1f173-02db-40d1-bafa-24b9ab5f8b8e tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-44fe35af-374f-435f-a576-2b2976892cff-delete_snapshot" released by "delete_snapshot" :: held 2.433s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:34 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:19:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:19:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:19:34 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] Creating offline snapshot a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2 of volume e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:19:35 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2310501f-1cea-4554-89f4-bcc37921758d]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9" returned: 0 in 0.376s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:19:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:35 devstack quobyte-client[83360]: System call of process 93840 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:35 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=63, name=volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:19:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2 1G" returned: 0 in 0.365s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:35 devstack quobyte-client[83360]: System call of process 93846 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] CMD "qemu-img rebase -u -b volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2" returned: 0 in 0.189s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:19:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2" returned: 0 in 0.166s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:19:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2" returned: 0 in 0.109s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.476s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:19:36 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-0bd0287f-a4e2-43ae-9f64-60d5d21026a1 tempest-SnapshotsActionsTest-1679667551 None] Create snapshot completed successfully
Sep 18 22:19:37 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Acquiring lock "cinder-a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:37 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:37 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:19:37 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Acquiring lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:37 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:37 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Acquiring lock "cinder-quobyte-a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:37 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Deleting offline snapshot a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2 of volume e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:19:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] snapshot_file for this snap is: volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:19:37 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd66ffe-680c-4b6c-b2aa-0068ae44fc86]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:37 devstack quobyte-client[83360]: System call of process 93862 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:37 devstack quobyte-client[83360]: System call of process 93862 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:37 devstack quobyte-client[83360]: System call of process 93862 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2" returned: 0 in 0.574s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:19:38 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd7c21e-0f1a-441e-8d25-54f7e1edf6a7]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:39 devstack quobyte-client[83360]: System call of process 93881 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9" returned: 0 in 1.454s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:19:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:39 devstack quobyte-client[83360]: System call of process 93914 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:39 devstack quobyte-client[83360]: System call of process 93914 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2" returned: 0 in 0.322s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2" returned: 0 in 0.180s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2" released by "_delete_snapshot" :: held 3.219s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" released by "delete_snapshot" :: held 3.255s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:41 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Created reservations ['1761605f-0663-4eed-be62-4390fa64854f', '00da76ee-928e-4c26-b0b4-de73bc57dfc6', '33b2badd-1a40-401a-8bbc-2ebae289787b', '5468c31e-d219-4c5d-a515-09823a6152a4'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:19:41 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Delete snapshot completed successfully.
Sep 18 22:19:41 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4bf5b6a6-e847-419f-9007-34f5d7e0a247 tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-a24fbe16-a6dc-441c-b7d1-d0b3e8b832a2-delete_snapshot" released by "delete_snapshot" :: held 3.962s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:42 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:19:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:19:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:19:42 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] Creating offline snapshot 672fd717-42a9-4107-a335-55b317b98992 of volume e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:19:42 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04ab293-3103-44ee-bc91-a2adc4708a22]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:43 devstack quobyte-client[83360]: System call of process 93937 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:43 devstack quobyte-client[83360]: System call of process 93937 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:43 devstack quobyte-client[83360]: System call of process 93937 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:43 devstack quobyte-client[83360]: System call of process 93937 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9" returned: 0 in 0.496s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:19:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:43 devstack quobyte-client[83360]: System call of process 93940 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:43 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=64, name=volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:19:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992 1G" returned: 0 in 0.515s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:44 devstack quobyte-client[83360]: System call of process 93946 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:44 devstack quobyte-client[83360]: System call of process 93946 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:44 devstack quobyte-client[83360]: System call of process 93946 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:44 devstack quobyte-client[83360]: System call of process 93946 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:44 devstack quobyte-client[83360]: System call of process 93946 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] CMD "qemu-img rebase -u -b volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992" returned: 0 in 0.228s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:19:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992" returned: 0 in 0.113s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:19:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992" returned: 0 in 0.089s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.744s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:19:44 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-d066d341-46b7-42da-b846-4c6f0244f629 tempest-SnapshotsActionsTest-1679667551 None] Create snapshot completed successfully
Sep 18 22:19:44 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Acquiring lock "cinder-672fd717-42a9-4107-a335-55b317b98992-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-672fd717-42a9-4107-a335-55b317b98992-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:45 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:19:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Acquiring lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Acquiring lock "cinder-quobyte-672fd717-42a9-4107-a335-55b317b98992" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-672fd717-42a9-4107-a335-55b317b98992" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Deleting offline snapshot 672fd717-42a9-4107-a335-55b317b98992 of volume e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:19:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] snapshot_file for this snap is: volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:19:45 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd643e2-d7ad-4ee4-a29f-852993f10cf4]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:45 devstack quobyte-client[83360]: System call of process 93952 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992" returned: 0 in 0.476s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:19:45 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddffc66-fa31-4c72-b956-6804815b59ee]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9" returned: 0 in 0.435s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:19:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992" returned: 0 in 0.313s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.672fd717-42a9-4107-a335-55b317b98992" returned: 0 in 0.155s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:19:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:19:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:19:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:19:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:19:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:19:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.182s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:19:47 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-672fd717-42a9-4107-a335-55b317b98992" released by "_delete_snapshot" :: held 2.033s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:47 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" released by "delete_snapshot" :: held 2.090s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:47 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Created reservations ['5f39e70a-4753-4f9b-94fe-a4c36267c9cb', '3e89ce47-2da6-4718-8624-d89e72164bf8', 'c3d276f7-e446-4315-b83d-e2e664173c10', '19349452-3e89-4dac-81d7-b65cf1a4069c'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:19:47 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Delete snapshot completed successfully.
Sep 18 22:19:47 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-dab3f853-b6c0-454c-afae-4a9d19098605 tempest-SnapshotsActionsTest-736482854 None] Lock "cinder-672fd717-42a9-4107-a335-55b317b98992-delete_snapshot" released by "delete_snapshot" :: held 2.530s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Acquiring lock "cinder-7a139db7-bb08-47ab-9f48-57eef32f06b9-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Lock "cinder-7a139db7-bb08-47ab-9f48-57eef32f06b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:49 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:19:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Acquiring lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Acquiring lock "cinder-quobyte-7a139db7-bb08-47ab-9f48-57eef32f06b9" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Lock "cinder-quobyte-7a139db7-bb08-47ab-9f48-57eef32f06b9" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Deleting offline snapshot 7a139db7-bb08-47ab-9f48-57eef32f06b9 of volume e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:19:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] snapshot_file for this snap is: volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:19:50 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf688436-892b-4cd5-87ef-24ca3373eaa1]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:51 devstack quobyte-client[83360]: System call of process 93977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:51 devstack quobyte-client[83360]: System call of process 93977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:51 devstack quobyte-client[83360]: System call of process 93977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9" returned: 0 in 1.274s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:51 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:19:51 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae5107f-3581-41d4-b997-8a02b3a510c9]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:52 devstack quobyte-client[83360]: System call of process 93983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:52 devstack quobyte-client[83360]: System call of process 93983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" returned: 0 in 0.964s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:53 devstack quobyte-client[83360]: System call of process 93986 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9" returned: 0 in 0.416s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d.7a139db7-bb08-47ab-9f48-57eef32f06b9" returned: 0 in 0.178s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:53 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Lock "cinder-quobyte-7a139db7-bb08-47ab-9f48-57eef32f06b9" released by "_delete_snapshot" :: held 3.782s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:53 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" released by "delete_snapshot" :: held 3.845s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:54 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Created reservations ['d9069516-cb07-434a-8ca3-d3268ad24097', '93bedeb0-f507-4f00-a9b6-ae5e3cbbc1eb', '5f1f6b73-5bec-4ca1-922d-c97c71f5c2aa', '08cbc791-fc33-4eb9-897f-9d43d6620792'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:19:54 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Delete snapshot completed successfully.
Sep 18 22:19:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ef514da2-31f2-4671-827b-ebb09ff9271b tempest-SnapshotsActionsTest-1679667551 None] Lock "cinder-7a139db7-bb08-47ab-9f48-57eef32f06b9-delete_snapshot" released by "delete_snapshot" :: held 4.477s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Acquiring lock "cinder-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Lock "cinder-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:55 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:19:55 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Acquiring lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:19:55 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" acquired by "delete_volume" :: waited 0.010s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:19:55 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7fd1f6-9d3a-40d1-82e0-262694dbc4ec]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:19:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:55 devstack quobyte-client[83360]: System call of process 93990 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:19:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" returned: 0 in 0.409s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" returned: 0 in 0.108s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:55 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Lock "cinder-quobyte-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d" released by "delete_volume" :: held 0.676s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:19:55 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Created reservations ['8bc9ded8-a85a-4dc6-8bee-2489719582be', 'b44bc4b1-ef25-49da-9f31-3038b7d6ee7c', '4cbf4389-3dfe-4987-b0c2-eb0552db83e5', 'e6d9ed56-7656-4695-bad0-29b765306e2a'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:19:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:19:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:19:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:19:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:19:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:19:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:19:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.100s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:19:56 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:19:56 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Deleted volume successfully.
Sep 18 22:19:56 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-195b257f-1fb8-49e0-8d41-e3f5899a7d22 tempest-SnapshotsActionsTest-1679667551 None] Lock "cinder-e6df3113-9d6e-4b3b-ac80-2dcb3c3e9a6d-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:20:04 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-fb090d7d-d6c6-49e3-a8a8-29b139e55df7 req-79a50ca7-6081-4473-a724-f0cacb96d2fa tempest-AttachVolumeTestJSON-1086341451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:20:04 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-fb090d7d-d6c6-49e3-a8a8-29b139e55df7 req-79a50ca7-6081-4473-a724-f0cacb96d2fa tempest-AttachVolumeTestJSON-1086341451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:20:04 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-fb090d7d-d6c6-49e3-a8a8-29b139e55df7 req-79a50ca7-6081-4473-a724-f0cacb96d2fa tempest-AttachVolumeTestJSON-1086341451 None] Terminate volume connection completed successfully.
Sep 18 22:20:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-fb090d7d-d6c6-49e3-a8a8-29b139e55df7 req-79a50ca7-6081-4473-a724-f0cacb96d2fa tempest-AttachVolumeTestJSON-1086341451 None] Deleting attachment 32500bde-f5e5-49fd-839f-b02f026c59ed. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:20:06 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=41,cinder:UPDATE=45,cinder:INSERT=19,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:20:14 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=41,cinder:DELETE=6,cinder:SELECT=34,cinder:INSERT=5 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:20:30 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Flow 'volume_create_manager' (1c518bba-0a81-4157-ad01-9c628e31348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ab5a8f-90b6-4a6a-8cb6-38e25b5ab90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ab5a8f-90b6-4a6a-8cb6-38e25b5ab90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-623173635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f874554-82e9-40f3-a3c9-d5d664128cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5e750ac7e434e69be258b5e24ad4ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:20:30Z,use_quota=True,user_id='a18bfb9765c045ceb69b1d2b4840df17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75170a7-7348-485e-9035-ecc234e2c8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75170a7-7348-485e-9035-ecc234e2c8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5001edac-d72a-429b-8b40-22d52682cfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5001edac-d72a-429b-8b40-22d52682cfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f874554-82e9-40f3-a3c9-d5d664128cb9', 'volume_name': 'volume-3f874554-82e9-40f3-a3c9-d5d664128cb9', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d17a2c-8e2a-412d-80fd-62b9ce8cb6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d17a2c-8e2a-412d-80fd-62b9ce8cb6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a60325-0430-4384-a2d1-9976b99e60dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:30 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Volume 3f874554-82e9-40f3-a3c9-d5d664128cb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f874554-82e9-40f3-a3c9-d5d664128cb9', 'volume_size': 1}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-623173635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f874554-82e9-40f3-a3c9-d5d664128cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5e750ac7e434e69be258b5e24ad4ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:20:30Z,use_quota=True,user_id='a18bfb9765c045ceb69b1d2b4840df17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Creating volume 3f874554-82e9-40f3-a3c9-d5d664128cb9 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:20:30 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:20:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3f874554-82e9-40f3-a3c9-d5d664128cb9 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:30 devstack quobyte-client[83360]: System call of process 94213 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:20:31 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=65, name=volume-3f874554-82e9-40f3-a3c9-d5d664128cb9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:20:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3f874554-82e9-40f3-a3c9-d5d664128cb9 1073741824" returned: 0 in 0.603s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3f874554-82e9-40f3-a3c9-d5d664128cb9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3f874554-82e9-40f3-a3c9-d5d664128cb9" returned: 0 in 0.243s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] <== create_volume: return (928ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:20:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:20:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a60325-0430-4384-a2d1-9976b99e60dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f874554-82e9-40f3-a3c9-d5d664128cb9', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbf168c-060f-4098-951c-52f33e989a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:32 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Volume volume-3f874554-82e9-40f3-a3c9-d5d664128cb9 (3f874554-82e9-40f3-a3c9-d5d664128cb9): created successfully
Sep 18 22:20:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbf168c-060f-4098-951c-52f33e989a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Flow 'volume_create_manager' (1c518bba-0a81-4157-ad01-9c628e31348d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:20:32 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-442710be-db91-490b-bc79-476f923bcefc tempest-VolumeQuotasAdminTestJSON-1510482956 None] Created volume successfully.
Sep 18 22:20:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Acquiring lock "cinder-3f874554-82e9-40f3-a3c9-d5d664128cb9-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:20:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Lock "cinder-3f874554-82e9-40f3-a3c9-d5d664128cb9-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:20:34 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:20:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Acquiring lock "cinder-quobyte-3f874554-82e9-40f3-a3c9-d5d664128cb9" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:20:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Lock "cinder-quobyte-3f874554-82e9-40f3-a3c9-d5d664128cb9" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:20:34 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[091634e4-7a9e-486a-938a-2fc60a3915a0]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:20:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3f874554-82e9-40f3-a3c9-d5d664128cb9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:34 devstack quobyte-client[83360]: System call of process 94220 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:20:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3f874554-82e9-40f3-a3c9-d5d664128cb9" returned: 0 in 0.479s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3f874554-82e9-40f3-a3c9-d5d664128cb9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3f874554-82e9-40f3-a3c9-d5d664128cb9" returned: 0 in 0.141s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Lock "cinder-quobyte-3f874554-82e9-40f3-a3c9-d5d664128cb9" released by "delete_volume" :: held 0.833s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:20:35 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Created reservations ['0b5c871b-4e42-4742-ba62-2136ebabb1d7', '064d5c98-4300-44b4-a7a7-f5c22cc48a63', '04bdaac2-e9fa-478f-bcf0-10ba05bd9d20', '85906ddf-cc81-4c73-8bb2-0096e802d638'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:20:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:20:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:20:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:20:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:20:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:20:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.141s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:35 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:20:35 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Deleted volume successfully.
Sep 18 22:20:35 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3b8e12d0-6732-495e-b60d-a4a1f50b029b tempest-VolumeQuotasAdminTestJSON-1510482956 None] Lock "cinder-3f874554-82e9-40f3-a3c9-d5d664128cb9-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:20:36 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Flow 'volume_create_manager' (4facc3f4-d302-4874-a9fb-028478409d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6d040c-f48b-4e8b-b042-77a83b3b4a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6d040c-f48b-4e8b-b042-77a83b3b4a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1732598414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a89e739-178a-4dba-b0ff-e0866126dd87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5e750ac7e434e69be258b5e24ad4ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:20:36Z,use_quota=True,user_id='a18bfb9765c045ceb69b1d2b4840df17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5398d458-6029-401e-a35c-4175056d3514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5398d458-6029-401e-a35c-4175056d3514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4119db-2c21-40b6-be65-fe7b37e77a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae4119db-2c21-40b6-be65-fe7b37e77a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a89e739-178a-4dba-b0ff-e0866126dd87', 'volume_name': 'volume-9a89e739-178a-4dba-b0ff-e0866126dd87', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9144f200-6f24-471c-9c04-8ad19a221731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9144f200-6f24-471c-9c04-8ad19a221731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4c07dd-9753-42be-80f9-947e4e5cad75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:36 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Volume 9a89e739-178a-4dba-b0ff-e0866126dd87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a89e739-178a-4dba-b0ff-e0866126dd87', 'volume_size': 1}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1732598414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a89e739-178a-4dba-b0ff-e0866126dd87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5e750ac7e434e69be258b5e24ad4ed1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:20:36Z,use_quota=True,user_id='a18bfb9765c045ceb69b1d2b4840df17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Creating volume 9a89e739-178a-4dba-b0ff-e0866126dd87 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:20:36 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:20:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9a89e739-178a-4dba-b0ff-e0866126dd87 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:37 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=66, name=volume-9a89e739-178a-4dba-b0ff-e0866126dd87, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:20:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9a89e739-178a-4dba-b0ff-e0866126dd87 1073741824" returned: 0 in 0.429s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9a89e739-178a-4dba-b0ff-e0866126dd87 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9a89e739-178a-4dba-b0ff-e0866126dd87" returned: 0 in 0.139s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] <== create_volume: return (668ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:20:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:20:37 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc4c07dd-9753-42be-80f9-947e4e5cad75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a89e739-178a-4dba-b0ff-e0866126dd87', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:37 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202165ad-2456-4d8d-be43-1e092339d9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:37 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Volume volume-9a89e739-178a-4dba-b0ff-e0866126dd87 (9a89e739-178a-4dba-b0ff-e0866126dd87): created successfully
Sep 18 22:20:37 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (202165ad-2456-4d8d-be43-1e092339d9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:37 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Flow 'volume_create_manager' (4facc3f4-d302-4874-a9fb-028478409d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:20:37 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-f63e4598-3ac4-4a2a-97af-b58243e8d88f tempest-VolumeQuotasAdminTestJSON-1510482956 None] Created volume successfully.
Sep 18 22:20:39 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-23111295-732d-40dd-8f57-21bc098db73f tempest-VolumeQuotasAdminTestJSON-1639419534 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:20:39 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-23111295-732d-40dd-8f57-21bc098db73f tempest-VolumeQuotasAdminTestJSON-1639419534 None] Transfer volume completed successfully.
Sep 18 22:20:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Acquiring lock "cinder-9a89e739-178a-4dba-b0ff-e0866126dd87-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:20:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Lock "cinder-9a89e739-178a-4dba-b0ff-e0866126dd87-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:20:40 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:20:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Acquiring lock "cinder-quobyte-9a89e739-178a-4dba-b0ff-e0866126dd87" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:20:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Lock "cinder-quobyte-9a89e739-178a-4dba-b0ff-e0866126dd87" acquired by "delete_volume" :: waited 0.019s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:20:40 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4967ea24-472b-4c5b-8f3b-358cea64a565]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:20:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9a89e739-178a-4dba-b0ff-e0866126dd87 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9a89e739-178a-4dba-b0ff-e0866126dd87" returned: 0 in 0.464s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9a89e739-178a-4dba-b0ff-e0866126dd87 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9a89e739-178a-4dba-b0ff-e0866126dd87" returned: 0 in 0.122s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:41 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Lock "cinder-quobyte-9a89e739-178a-4dba-b0ff-e0866126dd87" released by "delete_volume" :: held 0.798s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:20:41 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Created reservations ['27d94b8f-a909-4d59-8aaf-b4edb879a2c7', '70ccb3da-019c-4eb8-a818-ff257e4a35b3', '1003788a-9eb4-4d4a-b494-3c146b3d842c', '0cf9040c-0533-4771-b529-aec9d703dd7a'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:20:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:20:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:20:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:20:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:20:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:20:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.117s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:42 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:20:42 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Deleted volume successfully.
Sep 18 22:20:42 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-5ab9ae9b-3109-4bad-bb1d-44b08e3e2568 tempest-VolumeQuotasAdminTestJSON-1288332250 None] Lock "cinder-9a89e739-178a-4dba-b0ff-e0866126dd87-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:20:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:20:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:20:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:20:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:20:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:20:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:20:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.218s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:20:52 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=10,cinder:UPDATE=17,cinder:DELETE=3,cinder:INSERT=4 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:20:52 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=15,cinder:UPDATE=23,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:20:56 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Flow 'volume_create_manager' (8a90dadc-d4aa-4971-9db6-a9ccdb5b5305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb79ea74-7e72-43a2-aa3f-a7993ae18ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:56 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Flow 'volume_create_manager' (7eca1293-4ded-40fe-bc06-f52b76b48c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ccd46c3-4140-4191-b9d7-208c8792f342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb79ea74-7e72-43a2-aa3f-a7993ae18ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-952351039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42f5e89-4173-4578-b1ca-a3a3b4426378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a920fa035c7946a28a75f02b4e1776df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:20:56Z,use_quota=True,user_id='f2d05460bf4540b38020529ce8afb1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b93b81-cdee-4f3f-b224-afc9de0a81a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b93b81-cdee-4f3f-b224-afc9de0a81a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e26b5e-1296-4412-8701-34ac7986c323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e26b5e-1296-4412-8701-34ac7986c323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b42f5e89-4173-4578-b1ca-a3a3b4426378', 'volume_name': 'volume-b42f5e89-4173-4578-b1ca-a3a3b4426378', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b040d39a-e4ca-477d-9767-9389d39808bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b040d39a-e4ca-477d-9767-9389d39808bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df872985-7a16-4030-bc06-9d429569d43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:56 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Volume b42f5e89-4173-4578-b1ca-a3a3b4426378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b42f5e89-4173-4578-b1ca-a3a3b4426378', 'volume_size': 1}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-952351039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b42f5e89-4173-4578-b1ca-a3a3b4426378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a920fa035c7946a28a75f02b4e1776df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:20:56Z,use_quota=True,user_id='f2d05460bf4540b38020529ce8afb1f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Creating volume b42f5e89-4173-4578-b1ca-a3a3b4426378 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:20:56 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b42f5e89-4173-4578-b1ca-a3a3b4426378 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:56 devstack quobyte-client[83360]: System call of process 94268 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:20:56 devstack quobyte-client[83360]: System call of process 94268 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:20:56 devstack quobyte-client[83360]: System call of process 94268 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:20:56 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=67, name=volume-b42f5e89-4173-4578-b1ca-a3a3b4426378, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ccd46c3-4140-4191-b9d7-208c8792f342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-996645994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6501aef-477d-43ac-a44b-39138303a213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf2269ee85b4e2eb578813fc195d83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:20:56Z,use_quota=True,user_id='32d48a2aa8c0495aaad5e9e5d13ab150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f258bf0-f268-4ee1-a0eb-17ba87e9e8f7),volume_type_id=7f258bf0-f268-4ee1-a0eb-17ba87e9e8f7)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0333e2cb-c45e-47e1-b1bb-d1cb47213ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0333e2cb-c45e-47e1-b1bb-d1cb47213ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae9d494-0fff-47a4-b62a-07e43337af2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae9d494-0fff-47a4-b62a-07e43337af2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6501aef-477d-43ac-a44b-39138303a213', 'volume_name': 'volume-a6501aef-477d-43ac-a44b-39138303a213', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862c9632-e709-48da-81f0-7046f4db461c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (862c9632-e709-48da-81f0-7046f4db461c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f48c58-4035-4bf5-90cd-8b0346ccf3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:56 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Volume a6501aef-477d-43ac-a44b-39138303a213: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6501aef-477d-43ac-a44b-39138303a213', 'volume_size': 1}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b42f5e89-4173-4578-b1ca-a3a3b4426378 1073741824" returned: 0 in 0.519s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b42f5e89-4173-4578-b1ca-a3a3b4426378 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b42f5e89-4173-4578-b1ca-a3a3b4426378" returned: 0 in 0.191s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] <== create_volume: return (758ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.577s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-996645994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6501aef-477d-43ac-a44b-39138303a213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecf2269ee85b4e2eb578813fc195d83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:20:56Z,use_quota=True,user_id='32d48a2aa8c0495aaad5e9e5d13ab150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f258bf0-f268-4ee1-a0eb-17ba87e9e8f7),volume_type_id=7f258bf0-f268-4ee1-a0eb-17ba87e9e8f7)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Creating volume a6501aef-477d-43ac-a44b-39138303a213 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:20:57 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6501aef-477d-43ac-a44b-39138303a213 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:57 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=68, name=volume-a6501aef-477d-43ac-a44b-39138303a213, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df872985-7a16-4030-bc06-9d429569d43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b42f5e89-4173-4578-b1ca-a3a3b4426378', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6da489e-6af4-4ce9-9a50-690e199939bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:57 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Volume volume-b42f5e89-4173-4578-b1ca-a3a3b4426378 (b42f5e89-4173-4578-b1ca-a3a3b4426378): created successfully
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6da489e-6af4-4ce9-9a50-690e199939bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Flow 'volume_create_manager' (8a90dadc-d4aa-4971-9db6-a9ccdb5b5305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:20:57 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-bb9a18a9-9a56-41ba-8194-6e59f1a6cc09 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Created volume successfully.
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6501aef-477d-43ac-a44b-39138303a213 1073741824" returned: 0 in 0.549s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6501aef-477d-43ac-a44b-39138303a213 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6501aef-477d-43ac-a44b-39138303a213" returned: 0 in 0.168s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] <== create_volume: return (778ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:20:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:20:58 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f48c58-4035-4bf5-90cd-8b0346ccf3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6501aef-477d-43ac-a44b-39138303a213', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:58 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f73c29d-0f93-431e-a61e-4e4b2017b07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:20:58 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Volume volume-a6501aef-477d-43ac-a44b-39138303a213 (a6501aef-477d-43ac-a44b-39138303a213): created successfully
Sep 18 22:20:58 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f73c29d-0f93-431e-a61e-4e4b2017b07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:20:58 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Flow 'volume_create_manager' (7eca1293-4ded-40fe-bc06-f52b76b48c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:20:58 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-33380d63-c2ff-4e47-8605-c375fc2727ff tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Created volume successfully.
Sep 18 22:20:59 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-72ab5ed0-33cd-4086-9628-4612759ca8cb tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:20:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-72ab5ed0-33cd-4086-9628-4612759ca8cb tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:20:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-72ab5ed0-33cd-4086-9628-4612759ca8cb tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:20:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-72ab5ed0-33cd-4086-9628-4612759ca8cb tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:20:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-72ab5ed0-33cd-4086-9628-4612759ca8cb tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:20:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-72ab5ed0-33cd-4086-9628-4612759ca8cb tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:20:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-72ab5ed0-33cd-4086-9628-4612759ca8cb tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:20:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-72ab5ed0-33cd-4086-9628-4612759ca8cb tempest-VolumeRetypeWithoutMigrationTest-382880551 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.138s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:20:59 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-72ab5ed0-33cd-4086-9628-4612759ca8cb tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:21:00 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-72ab5ed0-33cd-4086-9628-4612759ca8cb tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Retype volume completed successfully.
Sep 18 22:21:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Acquiring lock "cinder-a6501aef-477d-43ac-a44b-39138303a213-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:21:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Lock "cinder-a6501aef-477d-43ac-a44b-39138303a213-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:21:01 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:21:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Acquiring lock "cinder-quobyte-a6501aef-477d-43ac-a44b-39138303a213" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:21:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Lock "cinder-quobyte-a6501aef-477d-43ac-a44b-39138303a213" acquired by "delete_volume" :: waited 0.027s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:21:01 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a39b6d3-99a2-4fae-90be-e806de6870cd]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:21:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6501aef-477d-43ac-a44b-39138303a213 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:02 devstack quobyte-client[83360]: System call of process 94285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:21:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6501aef-477d-43ac-a44b-39138303a213" returned: 0 in 0.772s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6501aef-477d-43ac-a44b-39138303a213 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6501aef-477d-43ac-a44b-39138303a213" returned: 0 in 0.115s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:02 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Lock "cinder-quobyte-a6501aef-477d-43ac-a44b-39138303a213" released by "delete_volume" :: held 1.186s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:21:02 devstack cinder-volume[83342]: WARNING cinder.quota [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:21:02 devstack cinder-volume[83342]: WARNING cinder.quota [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:21:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-81c902fa-0370-425d-bc54-bb23f1fed469 req-915909b6-ff77-4245-9edb-3b261bf6fa05 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-81c902fa-0370-425d-bc54-bb23f1fed469 req-915909b6-ff77-4245-9edb-3b261bf6fa05 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:03 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ddeb90-956c-4155-9b00-248e91403543]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:21:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-81c902fa-0370-425d-bc54-bb23f1fed469 req-915909b6-ff77-4245-9edb-3b261bf6fa05 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b42f5e89-4173-4578-b1ca-a3a3b4426378 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:03 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Created reservations ['5b7908bc-9031-425c-b4e7-fb08303b15c8', '0a000d0d-fa5d-4467-95b8-c826f33ae3e9', '3f32f88e-eb33-41a7-a5d3-2dc702bbdb88', 'a911f5ec-fc85-454b-afd5-5bfb0f611549'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:21:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:03 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:21:03 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:21:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:03 devstack quobyte-client[83360]: System call of process 94297 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:21:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-81c902fa-0370-425d-bc54-bb23f1fed469 req-915909b6-ff77-4245-9edb-3b261bf6fa05 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b42f5e89-4173-4578-b1ca-a3a3b4426378" returned: 0 in 0.799s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-81c902fa-0370-425d-bc54-bb23f1fed469 req-915909b6-ff77-4245-9edb-3b261bf6fa05 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.867s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.376s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:04 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:21:04 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Deleted volume successfully.
Sep 18 22:21:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0bb9748-8577-45ee-acbf-652ef2f51061 tempest-VolumeRetypeWithoutMigrationTest-382880551 None] Lock "cinder-a6501aef-477d-43ac-a44b-39138303a213-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:21:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-81c902fa-0370-425d-bc54-bb23f1fed469 req-915909b6-ff77-4245-9edb-3b261bf6fa05 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-b42f5e89-4173-4578-b1ca-a3a3b4426378', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '257df772-3639-4276-be47-865358243baa', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:21:04 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-81c902fa-0370-425d-bc54-bb23f1fed469 req-915909b6-ff77-4245-9edb-3b261bf6fa05 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:21:04 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-81c902fa-0370-425d-bc54-bb23f1fed469 req-915909b6-ff77-4245-9edb-3b261bf6fa05 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] attachment_update completed successfully.
Sep 18 22:21:11 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:21:11 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:21:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Flow 'volume_create_manager' (a1393f15-f6b5-42d5-ac92-1235166a0b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:21:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d02849-ef19-4408-b0a7-d12e738bcd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d02849-ef19-4408-b0a7-d12e738bcd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-278565935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e21694-a40d-487a-8e67-8a5f9a348df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a1b8fce4d749b5bb00a75405c98c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:21:12Z,use_quota=True,user_id='209d6029f8d0472e929a33f4dae319bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7660245b-e233-4340-9ca5-ed3441c76510),volume_type_id=7660245b-e233-4340-9ca5-ed3441c76510)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a269cb9-1e12-4540-9148-8cb6a8248818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a269cb9-1e12-4540-9148-8cb6a8248818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8525b1f-33f5-42f2-a3a2-4e1ae16429ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8525b1f-33f5-42f2-a3a2-4e1ae16429ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6e21694-a40d-487a-8e67-8a5f9a348df4', 'volume_name': 'volume-c6e21694-a40d-487a-8e67-8a5f9a348df4', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2259db7-484f-4169-88bb-25ca392046e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2259db7-484f-4169-88bb-25ca392046e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321c2483-34d9-4411-afd3-8837ab324d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:12 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Volume c6e21694-a40d-487a-8e67-8a5f9a348df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6e21694-a40d-487a-8e67-8a5f9a348df4', 'volume_size': 1}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-278565935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e21694-a40d-487a-8e67-8a5f9a348df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27a1b8fce4d749b5bb00a75405c98c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:21:12Z,use_quota=True,user_id='209d6029f8d0472e929a33f4dae319bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7660245b-e233-4340-9ca5-ed3441c76510),volume_type_id=7660245b-e233-4340-9ca5-ed3441c76510)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Creating volume c6e21694-a40d-487a-8e67-8a5f9a348df4 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:21:12 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c6e21694-a40d-487a-8e67-8a5f9a348df4 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:12 devstack quobyte-client[83360]: System call of process 94690 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:21:12 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=69, name=volume-c6e21694-a40d-487a-8e67-8a5f9a348df4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c6e21694-a40d-487a-8e67-8a5f9a348df4 1073741824" returned: 0 in 0.388s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c6e21694-a40d-487a-8e67-8a5f9a348df4 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c6e21694-a40d-487a-8e67-8a5f9a348df4" returned: 0 in 0.107s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] <== create_volume: return (599ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:21:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.614s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:13 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321c2483-34d9-4411-afd3-8837ab324d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6e21694-a40d-487a-8e67-8a5f9a348df4', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:13 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d897c9-4dae-47d8-8c92-6e83f644387f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:13 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Volume volume-c6e21694-a40d-487a-8e67-8a5f9a348df4 (c6e21694-a40d-487a-8e67-8a5f9a348df4): created successfully
Sep 18 22:21:13 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3d897c9-4dae-47d8-8c92-6e83f644387f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:13 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Flow 'volume_create_manager' (a1393f15-f6b5-42d5-ac92-1235166a0b99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:21:13 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e75413a0-ff67-4d94-be2d-0c33605796a3 tempest-VolumeTypesAccessTest-1898765334 None] Created volume successfully.
Sep 18 22:21:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Acquiring lock "cinder-c6e21694-a40d-487a-8e67-8a5f9a348df4-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:21:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Lock "cinder-c6e21694-a40d-487a-8e67-8a5f9a348df4-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:21:14 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:21:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Acquiring lock "cinder-quobyte-c6e21694-a40d-487a-8e67-8a5f9a348df4" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:21:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Lock "cinder-quobyte-c6e21694-a40d-487a-8e67-8a5f9a348df4" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:21:14 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db56e18-3d60-448c-ac46-d52f7c6d99f4]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:21:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c6e21694-a40d-487a-8e67-8a5f9a348df4 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c6e21694-a40d-487a-8e67-8a5f9a348df4" returned: 0 in 0.435s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c6e21694-a40d-487a-8e67-8a5f9a348df4 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c6e21694-a40d-487a-8e67-8a5f9a348df4" returned: 0 in 0.089s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Lock "cinder-quobyte-c6e21694-a40d-487a-8e67-8a5f9a348df4" released by "delete_volume" :: held 0.694s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:21:15 devstack cinder-volume[83342]: WARNING cinder.quota [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2109675686 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2109675686, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:21:15 devstack cinder-volume[83342]: WARNING cinder.quota [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2109675686 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2109675686, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:21:15 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Created reservations ['753680bc-9495-4d1e-abfd-965e0b50f113', 'b2cc7684-e690-4329-8425-c01a46a44291', '5b204c6e-95f6-45f5-968d-876636a5d2e9', 'de553693-9942-4e40-a7df-2ec4cf05cc71'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:21:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:21:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:21:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.082s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:15 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:21:15 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Deleted volume successfully.
Sep 18 22:21:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-de89b1e3-993e-4b3c-8905-1363bea02e5b tempest-VolumeTypesAccessTest-1898765334 None] Lock "cinder-c6e21694-a40d-487a-8e67-8a5f9a348df4-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:21:25 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=27,cinder:SELECT=22,cinder:DELETE=3,cinder:INSERT=6 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:21:29 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Flow 'volume_create_manager' (af7e44d6-a806-419b-b093-1818f2959fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7203d80-0dbc-4eb2-aeab-05fa5bdeeda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7203d80-0dbc-4eb2-aeab-05fa5bdeeda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-989048160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05ed2b03be540ce9b8089a9997c2e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:21:29Z,use_quota=True,user_id='46d116be259f4745b7471e165b2937a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23545d99-e087-48df-812f-727b6c02e2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23545d99-e087-48df-812f-727b6c02e2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8dda773-12fc-43ef-a55d-43ca3220f334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8dda773-12fc-43ef-a55d-43ca3220f334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9', 'volume_name': 'volume-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd08768-64c7-4972-9b7f-204c32ba1a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd08768-64c7-4972-9b7f-204c32ba1a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a51abf-b632-4dbc-b677-2087f295ea2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:29 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Volume 8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9', 'volume_size': 1}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-989048160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05ed2b03be540ce9b8089a9997c2e37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:21:29Z,use_quota=True,user_id='46d116be259f4745b7471e165b2937a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Creating volume 8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:21:29 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:21:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:29 devstack quobyte-client[83360]: System call of process 94796 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:21:29 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=70, name=volume-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:21:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9 1073741824" returned: 0 in 0.378s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9" returned: 0 in 0.123s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:30 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] <== create_volume: return (575ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:21:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.588s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a51abf-b632-4dbc-b677-2087f295ea2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1384dbc3-1735-439e-b9d8-9a2e84fc9b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:30 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Volume volume-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9 (8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9): created successfully
Sep 18 22:21:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1384dbc3-1735-439e-b9d8-9a2e84fc9b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:30 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Flow 'volume_create_manager' (af7e44d6-a806-419b-b093-1818f2959fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:21:30 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-7bedc697-a254-4998-b127-dab9d2b41063 tempest-VolumesMetadataTest-2093753667 None] Created volume successfully.
Sep 18 22:21:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Acquiring lock "cinder-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:21:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Lock "cinder-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:21:32 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:21:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Acquiring lock "cinder-quobyte-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:21:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Lock "cinder-quobyte-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9" acquired by "delete_volume" :: waited 0.014s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:21:32 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3724498c-2d39-42dc-b566-797b1bf6ac63]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:21:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9" returned: 0 in 0.404s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9" returned: 0 in 0.083s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Lock "cinder-quobyte-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9" released by "delete_volume" :: held 0.653s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:21:33 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Created reservations ['f769702a-9b4b-4f53-a87e-4e46623388cc', 'b5554397-3d74-4660-a95a-f0f053a14ac7', '1b460716-57b3-4251-a6f1-4de73ee8cc40', 'ac25590d-6992-4def-a40a-e85de302b31e'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:21:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:33 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:21:33 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:21:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.087s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:33 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:21:33 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Deleted volume successfully.
Sep 18 22:21:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-21fb44ae-90a8-4642-b96e-383b22f6011d tempest-VolumesMetadataTest-2093753667 None] Lock "cinder-8865e625-5de2-4dd3-9ab2-7a08a4cc5cd9-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:21:35 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-47e8d7f1-cabe-48c5-8217-d86a6f058d6e req-1fb365ad-9b44-41a6-85fc-4432f9472e69 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:21:35 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-47e8d7f1-cabe-48c5-8217-d86a6f058d6e req-1fb365ad-9b44-41a6-85fc-4432f9472e69 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:21:35 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-47e8d7f1-cabe-48c5-8217-d86a6f058d6e req-1fb365ad-9b44-41a6-85fc-4432f9472e69 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Terminate volume connection completed successfully.
Sep 18 22:21:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-47e8d7f1-cabe-48c5-8217-d86a6f058d6e req-1fb365ad-9b44-41a6-85fc-4432f9472e69 tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Deleting attachment 257df772-3639-4276-be47-865358243baa. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:21:37 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Acquiring lock "cinder-b42f5e89-4173-4578-b1ca-a3a3b4426378-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:21:37 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Lock "cinder-b42f5e89-4173-4578-b1ca-a3a3b4426378-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:21:37 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:21:37 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Acquiring lock "cinder-quobyte-b42f5e89-4173-4578-b1ca-a3a3b4426378" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:21:37 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Lock "cinder-quobyte-b42f5e89-4173-4578-b1ca-a3a3b4426378" acquired by "delete_volume" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:21:37 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f45299-acaf-4f9f-bc73-6ba8c40613f4]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:21:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b42f5e89-4173-4578-b1ca-a3a3b4426378 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:38 devstack quobyte-client[83360]: System call of process 94810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:21:38 devstack quobyte-client[83360]: System call of process 94810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:21:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b42f5e89-4173-4578-b1ca-a3a3b4426378" returned: 0 in 0.960s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b42f5e89-4173-4578-b1ca-a3a3b4426378 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b42f5e89-4173-4578-b1ca-a3a3b4426378" returned: 0 in 0.464s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:39 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Lock "cinder-quobyte-b42f5e89-4173-4578-b1ca-a3a3b4426378" released by "delete_volume" :: held 1.747s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:21:39 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Created reservations ['67f84b2e-8b69-4439-8cd9-8c2db5eed192', '1d169b81-323d-4b51-b5ef-5b8e7644116b', '4c4d6741-24ad-475d-b539-93ed26a59a5a', '33dd9317-32bc-429d-9953-752aaa80536b'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:21:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:21:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:21:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.117s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:39 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:21:39 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Deleted volume successfully.
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-943e342d-d014-4fda-87a9-d50ec31d595f tempest-TestServerVolumeAttachScenarioOldVersion-331771427 None] Lock "cinder-b42f5e89-4173-4578-b1ca-a3a3b4426378-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:21:40 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Flow 'volume_create_manager' (5381d442-820d-46d8-bbd6-8dffa018096d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd36ac13-6f96-49c5-9c5b-0de3b04ee3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd36ac13-6f96-49c5-9c5b-0de3b04ee3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-110100346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bd4257-9228-4d3b-9b46-296b14699b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e8d4ed54704c2fa7dfe10f6372da3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:21:41Z,use_quota=True,user_id='5cebff9d5c9e40d090e2a6f73ae59470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41537ecf-1721-473c-8a5a-5881af2d4e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41537ecf-1721-473c-8a5a-5881af2d4e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa86927d-fea6-4dee-8738-619432438aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa86927d-fea6-4dee-8738-619432438aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75bd4257-9228-4d3b-9b46-296b14699b6d', 'volume_name': 'volume-75bd4257-9228-4d3b-9b46-296b14699b6d', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43504dc6-dfcb-45ac-86e1-435319a7d830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43504dc6-dfcb-45ac-86e1-435319a7d830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cb7ab9-e8f5-41c2-9458-9525b1c9fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:40 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Volume 75bd4257-9228-4d3b-9b46-296b14699b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75bd4257-9228-4d3b-9b46-296b14699b6d', 'volume_size': 1}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-110100346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bd4257-9228-4d3b-9b46-296b14699b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e8d4ed54704c2fa7dfe10f6372da3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:21:41Z,use_quota=True,user_id='5cebff9d5c9e40d090e2a6f73ae59470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Creating volume 75bd4257-9228-4d3b-9b46-296b14699b6d {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:21:40 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:21:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-75bd4257-9228-4d3b-9b46-296b14699b6d 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:41 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=71, name=volume-75bd4257-9228-4d3b-9b46-296b14699b6d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:21:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-75bd4257-9228-4d3b-9b46-296b14699b6d 1073741824" returned: 0 in 0.573s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-75bd4257-9228-4d3b-9b46-296b14699b6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-75bd4257-9228-4d3b-9b46-296b14699b6d" returned: 0 in 0.208s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] <== create_volume: return (890ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:21:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04cb7ab9-e8f5-41c2-9458-9525b1c9fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75bd4257-9228-4d3b-9b46-296b14699b6d', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af3e0b6-d02c-408c-aaf2-cf24fbbabb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:42 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Volume volume-75bd4257-9228-4d3b-9b46-296b14699b6d (75bd4257-9228-4d3b-9b46-296b14699b6d): created successfully
Sep 18 22:21:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af3e0b6-d02c-408c-aaf2-cf24fbbabb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Flow 'volume_create_manager' (5381d442-820d-46d8-bbd6-8dffa018096d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:21:43 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c696fca6-b995-4879-95ed-f8110b08e8fa tempest-VolumesTransfersTest-1836554472 None] Created volume successfully.
Sep 18 22:21:45 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-6c57b50b-6ad7-4952-9334-032ebb28e98e tempest-VolumesTransfersTest-898067021 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:21:45 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-6c57b50b-6ad7-4952-9334-032ebb28e98e tempest-VolumesTransfersTest-898067021 None] Transfer volume completed successfully.
Sep 18 22:21:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Acquiring lock "cinder-75bd4257-9228-4d3b-9b46-296b14699b6d-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:21:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Lock "cinder-75bd4257-9228-4d3b-9b46-296b14699b6d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:21:46 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:21:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Acquiring lock "cinder-quobyte-75bd4257-9228-4d3b-9b46-296b14699b6d" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:21:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Lock "cinder-quobyte-75bd4257-9228-4d3b-9b46-296b14699b6d" acquired by "delete_volume" :: waited 0.042s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:21:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:21:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:21:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:21:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:47 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[30791cae-b49f-45f9-8293-21772991e3a4]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:21:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-75bd4257-9228-4d3b-9b46-296b14699b6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.396s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:21:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-75bd4257-9228-4d3b-9b46-296b14699b6d" returned: 0 in 0.539s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-75bd4257-9228-4d3b-9b46-296b14699b6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-75bd4257-9228-4d3b-9b46-296b14699b6d" returned: 0 in 0.085s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:47 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Lock "cinder-quobyte-75bd4257-9228-4d3b-9b46-296b14699b6d" released by "delete_volume" :: held 1.180s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:21:48 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Created reservations ['e966cce8-586d-43be-8736-3ab2b6a45859', '6a44079c-bd54-445f-b751-8fa815b20905', 'b630e673-7619-496e-94e8-96b88794e4cc', 'f7e50241-91d0-4fbc-a700-f551806ccd92'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:21:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:21:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:21:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.153s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:48 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:21:48 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Deleted volume successfully.
Sep 18 22:21:48 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6a16e81a-a1a6-4352-b314-464f5d6ede45 tempest-VolumesTransfersTest-1363703479 None] Lock "cinder-75bd4257-9228-4d3b-9b46-296b14699b6d-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:21:49 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Flow 'volume_create_manager' (41bbfe33-3ebf-48fe-94e9-e2831df30526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7e35f5-1257-4fad-a320-022ef6d7cdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7e35f5-1257-4fad-a320-022ef6d7cdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1528622334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac7a8ff-f11c-4c60-9007-83bbe314809a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e8d4ed54704c2fa7dfe10f6372da3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:21:49Z,use_quota=True,user_id='5cebff9d5c9e40d090e2a6f73ae59470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8999196-678d-491c-8f2c-9408a240a280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8999196-678d-491c-8f2c-9408a240a280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857d3722-2d46-4567-978f-b8ea6fd06ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857d3722-2d46-4567-978f-b8ea6fd06ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ac7a8ff-f11c-4c60-9007-83bbe314809a', 'volume_name': 'volume-5ac7a8ff-f11c-4c60-9007-83bbe314809a', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8bef96-eb73-4865-ba4c-ad4ee29a0dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8bef96-eb73-4865-ba4c-ad4ee29a0dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f50eba8e-1ca5-4938-9cef-9c9ee68ae720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:49 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Volume 5ac7a8ff-f11c-4c60-9007-83bbe314809a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ac7a8ff-f11c-4c60-9007-83bbe314809a', 'volume_size': 1}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1528622334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac7a8ff-f11c-4c60-9007-83bbe314809a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35e8d4ed54704c2fa7dfe10f6372da3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:21:49Z,use_quota=True,user_id='5cebff9d5c9e40d090e2a6f73ae59470',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Creating volume 5ac7a8ff-f11c-4c60-9007-83bbe314809a {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:21:49 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:21:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ac7a8ff-f11c-4c60-9007-83bbe314809a 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:49 devstack quobyte-client[83360]: System call of process 94902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:21:49 devstack quobyte-client[83360]: System call of process 94902 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:21:49 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=72, name=volume-5ac7a8ff-f11c-4c60-9007-83bbe314809a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:21:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ac7a8ff-f11c-4c60-9007-83bbe314809a 1073741824" returned: 0 in 0.561s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ac7a8ff-f11c-4c60-9007-83bbe314809a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ac7a8ff-f11c-4c60-9007-83bbe314809a" returned: 0 in 0.350s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] <== create_volume: return (988ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:21:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f50eba8e-1ca5-4938-9cef-9c9ee68ae720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ac7a8ff-f11c-4c60-9007-83bbe314809a', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f1ecc1-a033-4fd9-b345-9abfd08d659c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:21:50 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Volume volume-5ac7a8ff-f11c-4c60-9007-83bbe314809a (5ac7a8ff-f11c-4c60-9007-83bbe314809a): created successfully
Sep 18 22:21:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70f1ecc1-a033-4fd9-b345-9abfd08d659c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:21:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Flow 'volume_create_manager' (41bbfe33-3ebf-48fe-94e9-e2831df30526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:21:50 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-22be92f9-89b2-4961-b691-66b5c245fbf7 tempest-VolumesTransfersTest-1836554472 None] Created volume successfully.
Sep 18 22:21:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Acquiring lock "cinder-5ac7a8ff-f11c-4c60-9007-83bbe314809a-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:21:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Lock "cinder-5ac7a8ff-f11c-4c60-9007-83bbe314809a-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:21:52 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=50,cinder:UPDATE=54,cinder:DELETE=5,cinder:INSERT=6 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:21:52 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:21:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Acquiring lock "cinder-quobyte-5ac7a8ff-f11c-4c60-9007-83bbe314809a" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:21:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Lock "cinder-quobyte-5ac7a8ff-f11c-4c60-9007-83bbe314809a" acquired by "delete_volume" :: waited 0.025s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:21:52 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d101f209-48c4-4196-80a3-4330c28b7312]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:21:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ac7a8ff-f11c-4c60-9007-83bbe314809a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:53 devstack quobyte-client[83360]: System call of process 94910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:21:53 devstack quobyte-client[83360]: System call of process 94910 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:21:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ac7a8ff-f11c-4c60-9007-83bbe314809a" returned: 0 in 0.721s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ac7a8ff-f11c-4c60-9007-83bbe314809a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ac7a8ff-f11c-4c60-9007-83bbe314809a" returned: 0 in 0.160s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:53 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Lock "cinder-quobyte-5ac7a8ff-f11c-4c60-9007-83bbe314809a" released by "delete_volume" :: held 1.092s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:21:53 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Created reservations ['bc5cbbea-d175-4395-9065-2de8ef13a475', 'd97ce8f5-bdbd-46a6-bbb4-b6f774b4e603', '3b91b51d-a913-4c04-8830-24ef3d836bc9', '6180a204-0f06-487c-bac0-7c3655e52af4'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:21:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:21:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:21:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:21:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:21:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:21:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:21:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.115s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:21:54 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:21:54 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Deleted volume successfully.
Sep 18 22:21:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-01ca8762-4031-4b71-aa37-562575e685b2 tempest-VolumesTransfersTest-1363703479 None] Lock "cinder-5ac7a8ff-f11c-4c60-9007-83bbe314809a-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=3 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=25,cinder:UPDATE=49,cinder:DELETE=4,cinder:INSERT=10 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:22:04 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Flow 'volume_create_manager' (cdf8704b-17d5-4b7c-95f7-bb97bc689ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be92696c-1670-4bc9-855f-3fff358d041e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be92696c-1670-4bc9-855f-3fff358d041e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1875887255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b53c8d55-f079-4bd1-9f14-ab1273a565e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec338361816d49e7a6c49063663c0050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:22:05Z,use_quota=True,user_id='fcd07b0dc40b415fbda0c84b486d937a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbabe40c-8a54-4bde-92fc-64e74ed09734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbabe40c-8a54-4bde-92fc-64e74ed09734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee016e8-8550-434b-b93c-11d791ea88bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee016e8-8550-434b-b93c-11d791ea88bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b53c8d55-f079-4bd1-9f14-ab1273a565e5', 'volume_name': 'volume-b53c8d55-f079-4bd1-9f14-ab1273a565e5', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9048cf-a1d5-4c74-b6e5-ff8b52587e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9048cf-a1d5-4c74-b6e5-ff8b52587e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae57ec5-6949-4376-85a8-1f866a5fedfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:04 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Volume b53c8d55-f079-4bd1-9f14-ab1273a565e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b53c8d55-f079-4bd1-9f14-ab1273a565e5', 'volume_size': 1}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1875887255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b53c8d55-f079-4bd1-9f14-ab1273a565e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec338361816d49e7a6c49063663c0050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:22:05Z,use_quota=True,user_id='fcd07b0dc40b415fbda0c84b486d937a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Creating volume b53c8d55-f079-4bd1-9f14-ab1273a565e5 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:22:04 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:22:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b53c8d55-f079-4bd1-9f14-ab1273a565e5 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:05 devstack quobyte-client[83360]: System call of process 94921 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:22:05 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=73, name=volume-b53c8d55-f079-4bd1-9f14-ab1273a565e5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:22:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b53c8d55-f079-4bd1-9f14-ab1273a565e5 1073741824" returned: 0 in 0.533s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b53c8d55-f079-4bd1-9f14-ab1273a565e5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b53c8d55-f079-4bd1-9f14-ab1273a565e5" returned: 0 in 0.170s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:05 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] <== create_volume: return (831ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:22:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae57ec5-6949-4376-85a8-1f866a5fedfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b53c8d55-f079-4bd1-9f14-ab1273a565e5', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2025f26-8208-4de2-8da3-c924f574664a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:06 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Volume volume-b53c8d55-f079-4bd1-9f14-ab1273a565e5 (b53c8d55-f079-4bd1-9f14-ab1273a565e5): created successfully
Sep 18 22:22:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2025f26-8208-4de2-8da3-c924f574664a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Flow 'volume_create_manager' (cdf8704b-17d5-4b7c-95f7-bb97bc689ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:22:06 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-5aa0760f-7010-49fe-9221-5f8f67f34a55 tempest-VolumesTransfersV357Test-845709713 None] Created volume successfully.
Sep 18 22:22:07 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e4ce3935-5c42-4699-8117-bb740cd22151 tempest-VolumesTransfersV357Test-821856758 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:22:08 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e4ce3935-5c42-4699-8117-bb740cd22151 tempest-VolumesTransfersV357Test-821856758 None] Transfer volume completed successfully.
Sep 18 22:22:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Acquiring lock "cinder-b53c8d55-f079-4bd1-9f14-ab1273a565e5-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:22:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Lock "cinder-b53c8d55-f079-4bd1-9f14-ab1273a565e5-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:22:09 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:22:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Acquiring lock "cinder-quobyte-b53c8d55-f079-4bd1-9f14-ab1273a565e5" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:22:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Lock "cinder-quobyte-b53c8d55-f079-4bd1-9f14-ab1273a565e5" acquired by "delete_volume" :: waited 0.016s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:22:09 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bbb4bf-b491-432e-8d3b-297ecfa7fc7a]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:22:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b53c8d55-f079-4bd1-9f14-ab1273a565e5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:10 devstack quobyte-client[83360]: System call of process 94935 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:22:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b53c8d55-f079-4bd1-9f14-ab1273a565e5" returned: 0 in 1.142s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b53c8d55-f079-4bd1-9f14-ab1273a565e5 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b53c8d55-f079-4bd1-9f14-ab1273a565e5" returned: 0 in 0.209s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Lock "cinder-quobyte-b53c8d55-f079-4bd1-9f14-ab1273a565e5" released by "delete_volume" :: held 1.760s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:22:12 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Created reservations ['805d5e2e-fe8e-4ef4-8071-d4307e9b2cda', '7b3f17b3-5072-4ffa-a662-bbd94f6a5275', '052de12e-9c7e-4410-baad-057410968c74', '62f685b0-10da-4d55-a864-f2b48ccce0d0'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:22:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:22:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:22:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.102s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:12 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:22:12 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Deleted volume successfully.
Sep 18 22:22:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-448936c0-336a-4d02-8e31-3450c6278396 tempest-VolumesTransfersV357Test-972157560 None] Lock "cinder-b53c8d55-f079-4bd1-9f14-ab1273a565e5-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:22:13 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:22:13 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:22:13 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Flow 'volume_create_manager' (46597802-297a-4714-b383-ad88707b638d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:22:13 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8771ea8-ec11-48ec-b784-6df06c13044f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8771ea8-ec11-48ec-b784-6df06c13044f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-120217751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad63553-0e54-4df8-b2fd-c7b3f71d23bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec338361816d49e7a6c49063663c0050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:22:14Z,use_quota=True,user_id='fcd07b0dc40b415fbda0c84b486d937a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c734260d-9c74-4bd8-abe1-951ff2fad2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c734260d-9c74-4bd8-abe1-951ff2fad2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce71073b-f5ec-441f-a027-cc2a172ae8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce71073b-f5ec-441f-a027-cc2a172ae8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad63553-0e54-4df8-b2fd-c7b3f71d23bf', 'volume_name': 'volume-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5014766-4b6b-4b41-bab9-ec6f0ad743a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5014766-4b6b-4b41-bab9-ec6f0ad743a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb061fc-242f-49b1-8576-53cf8b8e51df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:14 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Volume 9ad63553-0e54-4df8-b2fd-c7b3f71d23bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf', 'volume_size': 1}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-120217751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad63553-0e54-4df8-b2fd-c7b3f71d23bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec338361816d49e7a6c49063663c0050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:22:14Z,use_quota=True,user_id='fcd07b0dc40b415fbda0c84b486d937a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Creating volume 9ad63553-0e54-4df8-b2fd-c7b3f71d23bf {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:22:14 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:14 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=74, name=volume-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf 1073741824" returned: 0 in 0.664s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf" returned: 0 in 0.147s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] <== create_volume: return (1023ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:22:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb061fc-242f-49b1-8576-53cf8b8e51df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0741ee7a-fe8f-43fc-935f-d1f5a626b6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:15 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Volume volume-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf (9ad63553-0e54-4df8-b2fd-c7b3f71d23bf): created successfully
Sep 18 22:22:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0741ee7a-fe8f-43fc-935f-d1f5a626b6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Flow 'volume_create_manager' (46597802-297a-4714-b383-ad88707b638d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:22:15 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-45f07083-20d5-4263-be75-b6b82d10338e tempest-VolumesTransfersV357Test-845709713 None] Created volume successfully.
Sep 18 22:22:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Acquiring lock "cinder-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:22:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Lock "cinder-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:22:16 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:22:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Acquiring lock "cinder-quobyte-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:22:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Lock "cinder-quobyte-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf" acquired by "delete_volume" :: waited 0.015s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:22:16 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1478b5-56ab-4e73-a364-6c5f8ab265d4]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:22:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:17 devstack quobyte-client[83360]: System call of process 94989 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:22:17 devstack quobyte-client[83360]: System call of process 94989 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:22:17 devstack quobyte-client[83360]: System call of process 94989 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:22:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf" returned: 0 in 0.589s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf" returned: 0 in 0.222s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Lock "cinder-quobyte-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf" released by "delete_volume" :: held 1.227s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:22:18 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Created reservations ['7b08b141-778e-4c87-b274-8bd212ee237e', '7094c0a2-a940-4a17-adc7-a964c7e742e7', 'fefa8ba3-d2f9-430b-aa62-a13194517435', '279d1f36-1f54-40f8-aa50-6cbbef6a5cc7'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:22:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:22:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:22:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.143s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:18 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:22:18 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Deleted volume successfully.
Sep 18 22:22:19 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e907dc9b-6401-4015-b01c-27f21be85bbc tempest-VolumesTransfersV357Test-972157560 None] Lock "cinder-9ad63553-0e54-4df8-b2fd-c7b3f71d23bf-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:22:28 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=24,cinder:SELECT=13,cinder:INSERT=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:22:28 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=12,cinder:UPDATE=16,cinder:DELETE=4,cinder:INSERT=6 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:22:31 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:22:31 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:22:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Flow 'volume_create_manager' (9c47939c-4628-423b-a509-c5f0ff2291ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:22:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd01c7e-65c5-41dd-930e-90913e41d1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd01c7e-65c5-41dd-930e-90913e41d1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1944287860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e88c144-3494-40d0-a4b8-1ee1b6d49a5f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5538ace256947378ff4b9da0ed91b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:22:31Z,use_quota=True,user_id='79fe43885d384b9e8f4f1383c171f0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d195243f-6936-459a-99dc-4b23e61e1bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d195243f-6936-459a-99dc-4b23e61e1bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21552708-204f-4170-95e6-3cf415a149d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21552708-204f-4170-95e6-3cf415a149d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e88c144-3494-40d0-a4b8-1ee1b6d49a5f', 'volume_name': 'volume-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244f2945-1ea0-4c49-a36a-f744894224b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (244f2945-1ea0-4c49-a36a-f744894224b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4958083-d888-4446-9905-3b16caa64fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:32 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Volume 5e88c144-3494-40d0-a4b8-1ee1b6d49a5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f', 'volume_size': 1}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1944287860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e88c144-3494-40d0-a4b8-1ee1b6d49a5f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5538ace256947378ff4b9da0ed91b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:22:31Z,use_quota=True,user_id='79fe43885d384b9e8f4f1383c171f0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Creating volume 5e88c144-3494-40d0-a4b8-1ee1b6d49a5f {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:22:32 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:22:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:32 devstack quobyte-client[83360]: System call of process 95079 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:22:32 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=75, name=volume-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:22:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f 1073741824" returned: 0 in 0.668s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f" returned: 0 in 0.197s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:33 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] <== create_volume: return (989ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:22:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:33 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4958083-d888-4446-9905-3b16caa64fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:33 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b0f2e2-ebbb-4a41-b179-9210c3ed7a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:33 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Volume volume-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f (5e88c144-3494-40d0-a4b8-1ee1b6d49a5f): created successfully
Sep 18 22:22:33 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b0f2e2-ebbb-4a41-b179-9210c3ed7a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:33 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Flow 'volume_create_manager' (9c47939c-4628-423b-a509-c5f0ff2291ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:22:33 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-777d62b5-9d7b-4c50-9420-6efed9e0d19d tempest-VolumesListTestJSON-636337316 None] Created volume successfully.
Sep 18 22:22:35 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:22:35 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:22:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Flow 'volume_create_manager' (a78455d6-9f17-41cf-9eb7-a5e4d967520b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:22:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d46c508-fda3-4223-a509-ff8c09ae8955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d46c508-fda3-4223-a509-ff8c09ae8955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-205146748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6977321-158a-4e32-86d4-938fa14a9e1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5538ace256947378ff4b9da0ed91b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:22:35Z,use_quota=True,user_id='79fe43885d384b9e8f4f1383c171f0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6087944f-0fd1-4978-9ac8-a1fe35061da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6087944f-0fd1-4978-9ac8-a1fe35061da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df39f93-8764-4e55-8dc5-f9ed2c7eb618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df39f93-8764-4e55-8dc5-f9ed2c7eb618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6977321-158a-4e32-86d4-938fa14a9e1d', 'volume_name': 'volume-b6977321-158a-4e32-86d4-938fa14a9e1d', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f522ed29-4bc4-40c6-87d0-41a69ba5550e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f522ed29-4bc4-40c6-87d0-41a69ba5550e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6e4845-6f52-4bb7-91ad-7408dc955263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:36 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Volume b6977321-158a-4e32-86d4-938fa14a9e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6977321-158a-4e32-86d4-938fa14a9e1d', 'volume_size': 1}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-205146748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6977321-158a-4e32-86d4-938fa14a9e1d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5538ace256947378ff4b9da0ed91b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:22:35Z,use_quota=True,user_id='79fe43885d384b9e8f4f1383c171f0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Creating volume b6977321-158a-4e32-86d4-938fa14a9e1d {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:22:36 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b6977321-158a-4e32-86d4-938fa14a9e1d 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:36 devstack quobyte-client[83360]: System call of process 95083 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:22:36 devstack quobyte-client[83360]: System call of process 95083 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:22:36 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=76, name=volume-b6977321-158a-4e32-86d4-938fa14a9e1d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b6977321-158a-4e32-86d4-938fa14a9e1d 1073741824" returned: 0 in 0.483s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b6977321-158a-4e32-86d4-938fa14a9e1d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b6977321-158a-4e32-86d4-938fa14a9e1d" returned: 0 in 0.225s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] <== create_volume: return (844ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:22:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:37 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f6e4845-6f52-4bb7-91ad-7408dc955263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6977321-158a-4e32-86d4-938fa14a9e1d', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:37 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e6b0f6-56f9-4504-aa18-df63e8a9b7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:37 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Volume volume-b6977321-158a-4e32-86d4-938fa14a9e1d (b6977321-158a-4e32-86d4-938fa14a9e1d): created successfully
Sep 18 22:22:37 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e6b0f6-56f9-4504-aa18-df63e8a9b7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:37 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Flow 'volume_create_manager' (a78455d6-9f17-41cf-9eb7-a5e4d967520b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:22:37 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-1691ce92-715c-4e3d-9205-08e13b423c88 tempest-VolumesListTestJSON-636337316 None] Created volume successfully.
Sep 18 22:22:38 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Flow 'volume_create_manager' (03b8ef02-53ab-445c-8dbd-4470edfc6711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1ca952-0eed-431a-bad4-c4c9b874c644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1ca952-0eed-431a-bad4-c4c9b874c644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2103231995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bb995f3-48e2-48bb-b732-2ee4c0e83190,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5538ace256947378ff4b9da0ed91b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:22:38Z,use_quota=True,user_id='79fe43885d384b9e8f4f1383c171f0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2e779c-8e16-46f7-a080-afbd4edacb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2e779c-8e16-46f7-a080-afbd4edacb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842ef956-bc55-4e58-98a8-a4ed55aafb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842ef956-bc55-4e58-98a8-a4ed55aafb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bb995f3-48e2-48bb-b732-2ee4c0e83190', 'volume_name': 'volume-7bb995f3-48e2-48bb-b732-2ee4c0e83190', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a08729-1aaa-464f-a069-8945e2ba884c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7a08729-1aaa-464f-a069-8945e2ba884c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936ca8b0-76fd-43df-85ee-7e7fe4c696dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:38 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Volume 7bb995f3-48e2-48bb-b732-2ee4c0e83190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bb995f3-48e2-48bb-b732-2ee4c0e83190', 'volume_size': 1}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2103231995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bb995f3-48e2-48bb-b732-2ee4c0e83190,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5538ace256947378ff4b9da0ed91b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:22:38Z,use_quota=True,user_id='79fe43885d384b9e8f4f1383c171f0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Creating volume 7bb995f3-48e2-48bb-b732-2ee4c0e83190 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:22:38 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:22:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7bb995f3-48e2-48bb-b732-2ee4c0e83190 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:38 devstack quobyte-client[83360]: System call of process 95087 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:22:38 devstack quobyte-client[83360]: System call of process 95087 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:22:38 devstack quobyte-client[83360]: System call of process 95087 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:22:38 devstack quobyte-client[83360]: System call of process 95087 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:22:38 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=77, name=volume-7bb995f3-48e2-48bb-b732-2ee4c0e83190, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:22:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7bb995f3-48e2-48bb-b732-2ee4c0e83190 1073741824" returned: 0 in 0.491s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7bb995f3-48e2-48bb-b732-2ee4c0e83190 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7bb995f3-48e2-48bb-b732-2ee4c0e83190" returned: 0 in 0.209s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] <== create_volume: return (847ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:22:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936ca8b0-76fd-43df-85ee-7e7fe4c696dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bb995f3-48e2-48bb-b732-2ee4c0e83190', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814524e0-ce9b-4476-9f5d-68ffb157c586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:22:39 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Volume volume-7bb995f3-48e2-48bb-b732-2ee4c0e83190 (7bb995f3-48e2-48bb-b732-2ee4c0e83190): created successfully
Sep 18 22:22:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814524e0-ce9b-4476-9f5d-68ffb157c586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:22:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Flow 'volume_create_manager' (03b8ef02-53ab-445c-8dbd-4470edfc6711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:22:39 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-8a2386c1-593f-4b9c-a2d4-69a56069a99f tempest-VolumesListTestJSON-636337316 None] Created volume successfully.
Sep 18 22:22:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Acquiring lock "cinder-7bb995f3-48e2-48bb-b732-2ee4c0e83190-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:22:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Lock "cinder-7bb995f3-48e2-48bb-b732-2ee4c0e83190-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:22:46 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:22:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Acquiring lock "cinder-quobyte-7bb995f3-48e2-48bb-b732-2ee4c0e83190" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:22:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Lock "cinder-quobyte-7bb995f3-48e2-48bb-b732-2ee4c0e83190" acquired by "delete_volume" :: waited 0.019s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:22:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:22:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:22:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:22:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:47 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f579e634-5311-444b-8149-f7a8699c4955]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:22:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7bb995f3-48e2-48bb-b732-2ee4c0e83190 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.315s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:22:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7bb995f3-48e2-48bb-b732-2ee4c0e83190" returned: 0 in 0.623s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7bb995f3-48e2-48bb-b732-2ee4c0e83190 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7bb995f3-48e2-48bb-b732-2ee4c0e83190" returned: 0 in 0.192s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:48 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Lock "cinder-quobyte-7bb995f3-48e2-48bb-b732-2ee4c0e83190" released by "delete_volume" :: held 1.189s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:22:48 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Created reservations ['59575b8b-cd70-443a-9548-a26c09ae83a9', '8ba43ed2-cd9c-4276-ac8e-cfea6f2b777d', '7deb0c85-6571-4854-9286-9123b315a439', '6e29c34b-77ad-461f-938b-5239f76e7808'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:22:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:22:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:22:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Acquiring lock "cinder-b6977321-158a-4e32-86d4-938fa14a9e1d-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:22:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.571s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:49 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:22:49 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Deleted volume successfully.
Sep 18 22:22:50 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Lock "cinder-b6977321-158a-4e32-86d4-938fa14a9e1d-delete_volume" acquired by "delete_volume" :: waited 0.430s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:22:50 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9f0bf883-cb44-4584-b51f-40dcd80f26f2 tempest-VolumesListTestJSON-636337316 None] Lock "cinder-7bb995f3-48e2-48bb-b732-2ee4c0e83190-delete_volume" released by "delete_volume" :: held 3.461s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:22:50 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:22:50 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Acquiring lock "cinder-quobyte-b6977321-158a-4e32-86d4-938fa14a9e1d" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:22:50 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Lock "cinder-quobyte-b6977321-158a-4e32-86d4-938fa14a9e1d" acquired by "delete_volume" :: waited 0.014s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:22:50 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2862f35-940d-4e6d-aaa9-5ae748215cbe]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:22:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b6977321-158a-4e32-86d4-938fa14a9e1d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:51 devstack quobyte-client[83360]: System call of process 95098 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:22:51 devstack quobyte-client[83360]: System call of process 95098 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:22:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b6977321-158a-4e32-86d4-938fa14a9e1d" returned: 0 in 1.148s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b6977321-158a-4e32-86d4-938fa14a9e1d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b6977321-158a-4e32-86d4-938fa14a9e1d" returned: 0 in 0.232s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:51 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Lock "cinder-quobyte-b6977321-158a-4e32-86d4-938fa14a9e1d" released by "delete_volume" :: held 1.636s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:22:52 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Created reservations ['f2327b22-576a-452b-acef-64e4c8d0b8bd', 'ae5b20e9-61a3-4d5d-aae5-c9da10db05b0', '65cb053d-73e1-4351-81d4-326dae550e2f', '62cc0a0d-4bd0-4ec4-a0a4-497dc824792b'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:22:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:22:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:22:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.301s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:53 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:22:54 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Deleted volume successfully.
Sep 18 22:22:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Acquiring lock "cinder-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:22:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Lock "cinder-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f-delete_volume" acquired by "delete_volume" :: waited 0.320s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:22:55 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c8db4583-e96d-46ac-87fc-0274fbfc136c tempest-VolumesListTestJSON-636337316 None] Lock "cinder-b6977321-158a-4e32-86d4-938fa14a9e1d-delete_volume" released by "delete_volume" :: held 5.028s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:22:55 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:22:55 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Acquiring lock "cinder-quobyte-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:22:55 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Lock "cinder-quobyte-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f" acquired by "delete_volume" :: waited 0.019s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:22:55 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a859a409-2df7-4c2e-a097-2d9c4fddc017]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:22:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f" returned: 0 in 0.875s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f" returned: 0 in 0.247s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:56 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Lock "cinder-quobyte-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f" released by "delete_volume" :: held 1.540s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:22:57 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Created reservations ['95743562-adad-4dc5-8d43-89873f5a34a0', '6fd347ae-a86d-4d7f-b8c7-b2b7369d0fb1', '936e82bf-efea-4646-b5d0-3e6672b5963a', '857493e9-119e-4add-ab80-fe25f1e34361'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:22:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:22:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:22:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:22:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:22:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:22:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:22:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.202s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:22:58 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:22:58 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Deleted volume successfully.
Sep 18 22:22:58 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-412c62f6-b96a-4459-bcaf-42f1e2e58ca2 tempest-VolumesListTestJSON-636337316 None] Lock "cinder-5e88c144-3494-40d0-a4b8-1ee1b6d49a5f-delete_volume" released by "delete_volume" :: held 3.444s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:23:03 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Flow 'volume_create_manager' (7392ce83-4804-4779-8dac-1792930f1b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b3c2ed-2353-4654-9942-b918fa52cf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b3c2ed-2353-4654-9942-b918fa52cf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1803258933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165e7133-f6d7-46a5-9b1c-34647bf8b83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362794f0c83d497991a20b678209c33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:23:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:23:03Z,use_quota=True,user_id='0a8ee4e5329c444d9d0b61f1bca60439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36dba3c6-a956-4924-bfcc-2cf9a69c0705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36dba3c6-a956-4924-bfcc-2cf9a69c0705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a84b3d0-1068-44ec-baac-56d0d514914e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a84b3d0-1068-44ec-baac-56d0d514914e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165e7133-f6d7-46a5-9b1c-34647bf8b83c', 'volume_name': 'volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c', 'volume_size': 2}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b70adb5-8114-4576-a69e-448653eb06af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b70adb5-8114-4576-a69e-448653eb06af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529c9792-2d43-4ca3-8e9f-a6abdf4dbebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:03 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Volume 165e7133-f6d7-46a5-9b1c-34647bf8b83c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c', 'volume_size': 2}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1803258933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165e7133-f6d7-46a5-9b1c-34647bf8b83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362794f0c83d497991a20b678209c33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:23:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:23:03Z,use_quota=True,user_id='0a8ee4e5329c444d9d0b61f1bca60439',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Creating volume 165e7133-f6d7-46a5-9b1c-34647bf8b83c {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:23:03 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:23:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c 2147483648 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:03 devstack quobyte-client[83360]: System call of process 95132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:03 devstack quobyte-client[83360]: System call of process 95132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:03 devstack quobyte-client[83360]: System call of process 95132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:03 devstack quobyte-client[83360]: System call of process 95132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:03 devstack quobyte-client[83360]: System call of process 95132 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:03 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=78, name=volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c 2147483648" returned: 0 in 0.721s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c" returned: 0 in 0.111s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] <== create_volume: return (909ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529c9792-2d43-4ca3-8e9f-a6abdf4dbebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c', 'volume_size': 2}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fddb4c8d-86d4-4b8f-b4a5-2bc8b23af168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:04 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Volume volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c (165e7133-f6d7-46a5-9b1c-34647bf8b83c): created successfully
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fddb4c8d-86d4-4b8f-b4a5-2bc8b23af168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Flow 'volume_create_manager' (7392ce83-4804-4779-8dac-1792930f1b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:23:04 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-ccac7ecc-30f8-4c68-ac06-8473b63c4d55 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Created volume successfully.
Sep 18 22:23:04 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Flow 'volume_create_manager' (3439242e-5c48-41b5-9d09-8c269c64c6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52319341-8be6-4c16-a345-f874f49bfa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52319341-8be6-4c16-a345-f874f49bfa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1960617423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b5711e-5028-4b98-93be-e10b1b0549ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='570614fbd2e44449a358bb523f6116df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:23:05Z,use_quota=True,user_id='0912f4dad2c042ec8d907517c25f5832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b1832f-0402-4ab0-b43a-e1db4c3e516d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b1832f-0402-4ab0-b43a-e1db4c3e516d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:04 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19030ef-3bf6-49d7-8d36-e456edcd96d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c19030ef-3bf6-49d7-8d36-e456edcd96d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98b5711e-5028-4b98-93be-e10b1b0549ae', 'volume_name': 'volume-98b5711e-5028-4b98-93be-e10b1b0549ae', 'volume_size': 1, 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b51f48f363a84a708334255554fa3921', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'created_at': datetime.datetime(2025, 9, 18, 19, 51, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 19, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e9f9b45e-88d0-41ad-b728-fb173316839e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f90545c43a0>}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0e8d0c-96d2-4b18-ae3c-970698ecedf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0e8d0c-96d2-4b18-ae3c-970698ecedf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a9ebb7-8a17-49a7-9422-00ce8f4356eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:05 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Volume 98b5711e-5028-4b98-93be-e10b1b0549ae: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98b5711e-5028-4b98-93be-e10b1b0549ae', 'volume_size': 1, 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b51f48f363a84a708334255554fa3921', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'created_at': datetime.datetime(2025, 9, 18, 19, 51, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 19, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e9f9b45e-88d0-41ad-b728-fb173316839e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f90545c43a0>}
Sep 18 22:23:05 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Cloning 98b5711e-5028-4b98-93be-e10b1b0549ae from image e9f9b45e-88d0-41ad-b728-fb173316839e  at location (None, None). {{(pid=83342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 18 22:23:05 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:23:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:05 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Creating offline snapshot af64da55-a1c1-4d32-a9c7-40b4c784cd4f of volume 165e7133-f6d7-46a5-9b1c-34647bf8b83c {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:23:05 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7b2c6e-a5ff-4bf8-9f74-67c84c84ccd3]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:23:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:06 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_igxidda0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 22:23:06 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Image download 20.69 MB at 20.69 MB/s
Sep 18 22:23:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c" returned: 0 in 0.595s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f 2G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:06 devstack quobyte-client[83360]: System call of process 95139 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:06 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=79, name=volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:23:06 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9b0ebc-ad69-45dd-8f7e-3136d4187f9d]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:23:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_igxidda0devstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f 2G" returned: 0 in 0.340s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): qemu-img rebase -u -b volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:06 devstack quobyte-client[83360]: System call of process 95143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "qemu-img rebase -u -b volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f" returned: 0 in 0.157s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:23:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f" returned: 0 in 0.104s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:23:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:07 devstack sudo[95142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_igxidda0devstack@QuobyteHD
Sep 18 22:23:07 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:23:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f" returned: 0 in 0.104s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.info" returned: 0 in 0.099s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:07 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:23:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.info" returned: 0 in 0.089s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:07 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-f2111456-460c-4f36-a4c8-85ff594d4063 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Create snapshot completed successfully
Sep 18 22:23:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Acquiring lock "cinder-af64da55-a1c1-4d32-a9c7-40b4c784cd4f-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:23:08 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root
Sep 18 22:23:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_igxidda0devstack@QuobyteHD" returned: 0 in 2.424s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:08 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Temporary image e9f9b45e-88d0-41ad-b728-fb173316839e is fetched for user 0912f4dad2c042ec8d907517c25f5832. {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 22:23:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "cinder-af64da55-a1c1-4d32-a9c7-40b4c784cd4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.091s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:23:08 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:23:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Acquiring lock "cinder-quobyte-165e7133-f6d7-46a5-9b1c-34647bf8b83c" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:23:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "cinder-quobyte-165e7133-f6d7-46a5-9b1c-34647bf8b83c" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:23:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Acquiring lock "cinder-quobyte-af64da55-a1c1-4d32-a9c7-40b4c784cd4f" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:23:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "cinder-quobyte-af64da55-a1c1-4d32-a9c7-40b4c784cd4f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:23:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Deleting offline snapshot af64da55-a1c1-4d32-a9c7-40b4c784cd4f of volume 165e7133-f6d7-46a5-9b1c-34647bf8b83c {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:23:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] snapshot_file for this snap is: volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:23:09 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bd3db2-4e11-47ba-8e6a-4fb813b953a7]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:23:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:09 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd436b1-2761-4d9b-8d5a-e71c32032340]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:23:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_igxidda0devstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:09 devstack quobyte-client[83360]: System call of process 95154 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f" returned: 0 in 0.508s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:23:09 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[371610ff-fae6-439c-bba0-19fe52b79732]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:23:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:09 devstack sudo[95155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_igxidda0devstack@QuobyteHD
Sep 18 22:23:09 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:23:10 devstack quobyte-client[83360]: System call of process 95158 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c" returned: 0 in 0.483s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f" returned: 0 in 0.290s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c.af64da55-a1c1-4d32-a9c7-40b4c784cd4f" returned: 0 in 0.121s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:10 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "cinder-quobyte-af64da55-a1c1-4d32-a9c7-40b4c784cd4f" released by "_delete_snapshot" :: held 1.868s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:23:10 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "cinder-quobyte-165e7133-f6d7-46a5-9b1c-34647bf8b83c" released by "delete_snapshot" :: held 1.898s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:23:11 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Created reservations ['e036d0e0-649c-4d75-89c0-64391f14d98b', 'ff51e083-7ab1-444f-80a8-320a88d62d66', '3db3e281-7a75-45a2-90b4-e31d6b5e8ab5', '9aeb705e-e885-46f7-b603-5173f2eccfaf'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:23:11 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Delete snapshot completed successfully.
Sep 18 22:23:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8cc8695a-30f0-409e-a797-d51b882efd3b tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "cinder-af64da55-a1c1-4d32-a9c7-40b4c784cd4f-delete_snapshot" released by "delete_snapshot" :: held 2.394s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:23:11 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root
Sep 18 22:23:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_igxidda0devstack@QuobyteHD" returned: 0 in 2.394s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1960617423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98b5711e-5028-4b98-93be-e10b1b0549ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='570614fbd2e44449a358bb523f6116df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:23:05Z,use_quota=True,user_id='0912f4dad2c042ec8d907517c25f5832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:23:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Creating volume 98b5711e-5028-4b98-93be-e10b1b0549ae {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:23:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:23:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:23:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:23:11 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:23:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:11 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=81, name=volume-98b5711e-5028-4b98-93be-e10b1b0549ae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:23:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae 1073741824" returned: 0 in 0.313s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Acquiring lock "cinder-165e7133-f6d7-46a5-9b1c-34647bf8b83c-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:23:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae" returned: 0 in 0.261s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] <== create_volume: return (626ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:23:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.639s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "cinder-165e7133-f6d7-46a5-9b1c-34647bf8b83c-delete_volume" acquired by "delete_volume" :: waited 0.174s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:23:12 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Attempting download of e9f9b45e-88d0-41ad-b728-fb173316839e ((None, None)) to volume 98b5711e-5028-4b98-93be-e10b1b0549ae. {{(pid=83342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 22:23:12 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25b799b-7ceb-4998-9e65-cec17473f05e]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:23:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_phzsw4vx {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:12 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:23:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Acquiring lock "cinder-quobyte-165e7133-f6d7-46a5-9b1c-34647bf8b83c" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:23:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "cinder-quobyte-165e7133-f6d7-46a5-9b1c-34647bf8b83c" acquired by "delete_volume" :: waited 0.109s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:23:13 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[78287b16-a3e4-456f-843e-e591cf77e74f]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:23:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_phzsw4vx" returned: 0 in 0.534s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_phzsw4vx {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:13 devstack quobyte-client[83360]: System call of process 95176 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c" returned: 0 in 0.627s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-165e7133-f6d7-46a5-9b1c-34647bf8b83c" returned: 0 in 0.166s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_phzsw4vx" returned: 1 in 0.687s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_phzsw4vx' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:23:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "cinder-quobyte-165e7133-f6d7-46a5-9b1c-34647bf8b83c" released by "delete_volume" :: held 1.021s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:23:14 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd6e911-11a8-44a7-aea7-489dfbe13a6c]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:23:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_igxidda0devstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:14 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Created reservations ['e10febd4-9857-4b27-81f5-2fc8f9769f43', '03275c07-920d-414f-a3e4-1da68ffe1185', '1ef72e75-92d2-4a2c-bad8-c96dff2b7c0b', '0293387e-1f1f-4d29-bc51-2abc4214fdc3'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:23:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_igxidda0devstack@QuobyteHD" returned: 0 in 0.572s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:14 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] e9f9b45e-88d0-41ad-b728-fb173316839e was qcow2, converting to raw {{(pid=83342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 22:23:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_igxidda0devstack@QuobyteHD /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:14 devstack quobyte-client[83360]: System call of process 95186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:14 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=81, name=volume-98b5711e-5028-4b98-93be-e10b1b0549ae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:23:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.031s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:23:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:23:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.177s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:15 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:23:15 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Deleted volume successfully.
Sep 18 22:23:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_igxidda0devstack@QuobyteHD /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae" returned: 0 in 1.849s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:16 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_igxidda0devstack@QuobyteHD, size 112.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae {{(pid=83342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 22:23:16 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Converted 112.00 MB image at 60.38 MB/s
Sep 18 22:23:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:16 devstack quobyte-client[83360]: System call of process 95226 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:16 devstack quobyte-client[83360]: System call of process 95226 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3a03d048-184c-4fcf-9d53-fb2aa235a4e1 tempest-VolumesSnapshotNegativeTestJSON-1352694510 None] Lock "cinder-165e7133-f6d7-46a5-9b1c-34647bf8b83c-delete_volume" released by "delete_volume" :: held 4.357s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:23:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae 1G" returned: 0 in 0.471s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:17 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3999b9c0-800d-48ef-a455-69d19206b620]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:23:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:17 devstack quobyte-client[83360]: System call of process 95229 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae" returned: 0 in 0.511s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae" returned: 1 in 0.527s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:23:18 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Downloaded image e9f9b45e-88d0-41ad-b728-fb173316839e ((None, None)) to volume 98b5711e-5028-4b98-93be-e10b1b0549ae successfully. {{(pid=83342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 22:23:18 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Temporary image e9f9b45e-88d0-41ad-b728-fb173316839e for user 0912f4dad2c042ec8d907517c25f5832 is deleted. {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 22:23:18 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Marking volume 98b5711e-5028-4b98-93be-e10b1b0549ae as bootable. {{(pid=83342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 22:23:18 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Copying metadata from image e9f9b45e-88d0-41ad-b728-fb173316839e to 98b5711e-5028-4b98-93be-e10b1b0549ae. {{(pid=83342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 22:23:18 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Creating volume glance metadata for volume 98b5711e-5028-4b98-93be-e10b1b0549ae backed by image e9f9b45e-88d0-41ad-b728-fb173316839e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 22:23:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a9ebb7-8a17-49a7-9422-00ce8f4356eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98b5711e-5028-4b98-93be-e10b1b0549ae', 'volume_size': 1, 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b51f48f363a84a708334255554fa3921', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'created_at': datetime.datetime(2025, 9, 18, 19, 51, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 19, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e9f9b45e-88d0-41ad-b728-fb173316839e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f90545c43a0>}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b6a133-057c-45ba-88e0-0df088e080eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:18 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Volume volume-98b5711e-5028-4b98-93be-e10b1b0549ae (98b5711e-5028-4b98-93be-e10b1b0549ae): created successfully
Sep 18 22:23:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b6a133-057c-45ba-88e0-0df088e080eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Flow 'volume_create_manager' (3439242e-5c48-41b5-9d09-8c269c64c6b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:23:18 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-615e1974-01c2-4d45-8266-d9f9f8e45b73 tempest-TestShelveInstance-1009296260 None] Created volume successfully.
Sep 18 22:23:29 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=50,cinder:DELETE=5,cinder:SELECT=44,cinder:INSERT=22 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:23:30 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=36,cinder:UPDATE=51,cinder:DELETE=5,cinder:INSERT=11 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:23:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-f2e33d62-7f59-4de5-ab62-44f672ddfd7d req-765d4d0e-046a-4fe0-8d61-535629f40387 tempest-TestShelveInstance-1009296260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-f2e33d62-7f59-4de5-ab62-44f672ddfd7d req-765d4d0e-046a-4fe0-8d61-535629f40387 tempest-TestShelveInstance-1009296260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:30 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[913ba0f4-91e0-4be1-ae83-ff78d7a810c0]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:23:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-f2e33d62-7f59-4de5-ab62-44f672ddfd7d req-765d4d0e-046a-4fe0-8d61-535629f40387 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:30 devstack quobyte-client[83360]: System call of process 95264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-f2e33d62-7f59-4de5-ab62-44f672ddfd7d req-765d4d0e-046a-4fe0-8d61-535629f40387 tempest-TestShelveInstance-1009296260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae" returned: 0 in 0.685s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-f2e33d62-7f59-4de5-ab62-44f672ddfd7d req-765d4d0e-046a-4fe0-8d61-535629f40387 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:31 devstack quobyte-client[83360]: System call of process 95267 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:31 devstack quobyte-client[83360]: System call of process 95267 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-f2e33d62-7f59-4de5-ab62-44f672ddfd7d req-765d4d0e-046a-4fe0-8d61-535629f40387 tempest-TestShelveInstance-1009296260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae" returned: 1 in 0.870s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-f2e33d62-7f59-4de5-ab62-44f672ddfd7d req-765d4d0e-046a-4fe0-8d61-535629f40387 tempest-TestShelveInstance-1009296260 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:23:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-f2e33d62-7f59-4de5-ab62-44f672ddfd7d req-765d4d0e-046a-4fe0-8d61-535629f40387 tempest-TestShelveInstance-1009296260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.960s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:32 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-f2e33d62-7f59-4de5-ab62-44f672ddfd7d req-765d4d0e-046a-4fe0-8d61-535629f40387 tempest-TestShelveInstance-1009296260 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-98b5711e-5028-4b98-93be-e10b1b0549ae', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72e2df12-3474-4d80-a386-4c4479af0e1b', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:23:32 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-f2e33d62-7f59-4de5-ab62-44f672ddfd7d req-765d4d0e-046a-4fe0-8d61-535629f40387 tempest-TestShelveInstance-1009296260 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:23:33 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-f2e33d62-7f59-4de5-ab62-44f672ddfd7d req-765d4d0e-046a-4fe0-8d61-535629f40387 tempest-TestShelveInstance-1009296260 None] attachment_update completed successfully.
Sep 18 22:23:34 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Flow 'volume_create_manager' (29a2159f-5359-4ced-b346-b627c510e11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e00ac4-26a4-4c9a-9569-2c63b95ece0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e00ac4-26a4-4c9a-9569-2c63b95ece0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-851915634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c942947c-8cf3-4232-afa0-787c2dee7536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e09e144137477592f58df68593263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:23:35Z,use_quota=True,user_id='cb6b6b3a909b44afa722627c3adf111e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d76bf3-0037-4269-9ea9-fc84715aada6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d76bf3-0037-4269-9ea9-fc84715aada6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e471b6-ca9a-45c9-a4bb-5132ed9c988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e471b6-ca9a-45c9-a4bb-5132ed9c988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c942947c-8cf3-4232-afa0-787c2dee7536', 'volume_name': 'volume-c942947c-8cf3-4232-afa0-787c2dee7536', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cfe5f1-b999-4c5c-9d21-a48bc275fd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92cfe5f1-b999-4c5c-9d21-a48bc275fd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ba66ab-7520-46ae-ad95-a55e3d9d0e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:35 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Volume c942947c-8cf3-4232-afa0-787c2dee7536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c942947c-8cf3-4232-afa0-787c2dee7536', 'volume_size': 1}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:23:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-851915634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c942947c-8cf3-4232-afa0-787c2dee7536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e09e144137477592f58df68593263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:23:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:23:35Z,use_quota=True,user_id='cb6b6b3a909b44afa722627c3adf111e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Creating volume c942947c-8cf3-4232-afa0-787c2dee7536 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:23:35 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c942947c-8cf3-4232-afa0-787c2dee7536 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:35 devstack quobyte-client[83360]: System call of process 95272 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:35 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=82, name=volume-c942947c-8cf3-4232-afa0-787c2dee7536, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c942947c-8cf3-4232-afa0-787c2dee7536 1073741824" returned: 0 in 0.530s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c942947c-8cf3-4232-afa0-787c2dee7536 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c942947c-8cf3-4232-afa0-787c2dee7536" returned: 0 in 0.222s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] <== create_volume: return (855ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:23:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15ba66ab-7520-46ae-ad95-a55e3d9d0e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c942947c-8cf3-4232-afa0-787c2dee7536', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35949b2-974a-49a2-b760-e1c6f337f716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:36 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Volume volume-c942947c-8cf3-4232-afa0-787c2dee7536 (c942947c-8cf3-4232-afa0-787c2dee7536): created successfully
Sep 18 22:23:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35949b2-974a-49a2-b760-e1c6f337f716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Flow 'volume_create_manager' (29a2159f-5359-4ced-b346-b627c510e11f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:23:36 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c203c587-0033-452e-b5a0-f66a3dca7d86 tempest-AttachVolumeTestJSON-1086341451 None] Created volume successfully.
Sep 18 22:23:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-06e6d9ef-8818-4e7a-9af7-27f2c836af4a req-81b11891-98ad-41bf-b839-29c3825af873 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-06e6d9ef-8818-4e7a-9af7-27f2c836af4a req-81b11891-98ad-41bf-b839-29c3825af873 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:41 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cf50e0-417b-4b36-aa0c-c11b4a4c7a0e]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:23:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-06e6d9ef-8818-4e7a-9af7-27f2c836af4a req-81b11891-98ad-41bf-b839-29c3825af873 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c942947c-8cf3-4232-afa0-787c2dee7536 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-06e6d9ef-8818-4e7a-9af7-27f2c836af4a req-81b11891-98ad-41bf-b839-29c3825af873 tempest-AttachVolumeTestJSON-1086341451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c942947c-8cf3-4232-afa0-787c2dee7536" returned: 0 in 0.722s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-06e6d9ef-8818-4e7a-9af7-27f2c836af4a req-81b11891-98ad-41bf-b839-29c3825af873 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.819s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-06e6d9ef-8818-4e7a-9af7-27f2c836af4a req-81b11891-98ad-41bf-b839-29c3825af873 tempest-AttachVolumeTestJSON-1086341451 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-c942947c-8cf3-4232-afa0-787c2dee7536', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b42d63ec-d26d-4cd9-8b09-681da41c5b1f', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:23:42 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-06e6d9ef-8818-4e7a-9af7-27f2c836af4a req-81b11891-98ad-41bf-b839-29c3825af873 tempest-AttachVolumeTestJSON-1086341451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:23:43 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-06e6d9ef-8818-4e7a-9af7-27f2c836af4a req-81b11891-98ad-41bf-b839-29c3825af873 tempest-AttachVolumeTestJSON-1086341451 None] attachment_update completed successfully.
Sep 18 22:23:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:23:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:23:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:23:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.182s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:23:48 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:23:48 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:23:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Flow 'volume_create_manager' (7771fcb0-ba54-4b9e-a9ec-3ece571c3746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:23:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63935c68-faf1-4ac8-a10f-947535d6bd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63935c68-faf1-4ac8-a10f-947535d6bd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1175851173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4552dde-187d-49d3-a03b-b6716782861f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef178f4a7c2483c906954769df065c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:23:48Z,use_quota=True,user_id='2da8723098784ae5854fa51a0d7fa2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbf44c7-9974-40b2-a98a-d05c97b92e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbf44c7-9974-40b2-a98a-d05c97b92e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89aa4530-1cce-4c52-9cf8-60b048c8577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89aa4530-1cce-4c52-9cf8-60b048c8577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4552dde-187d-49d3-a03b-b6716782861f', 'volume_name': 'volume-d4552dde-187d-49d3-a03b-b6716782861f', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccbe8df-5e67-4700-b79c-6febfd89f4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccbe8df-5e67-4700-b79c-6febfd89f4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811b1635-d665-4dba-bbf4-ce450a59ac08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:49 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume d4552dde-187d-49d3-a03b-b6716782861f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4552dde-187d-49d3-a03b-b6716782861f', 'volume_size': 1}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.017s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1175851173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4552dde-187d-49d3-a03b-b6716782861f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef178f4a7c2483c906954769df065c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:23:48Z,use_quota=True,user_id='2da8723098784ae5854fa51a0d7fa2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Creating volume d4552dde-187d-49d3-a03b-b6716782861f {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.093s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:23:49 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:23:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d4552dde-187d-49d3-a03b-b6716782861f 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:49 devstack quobyte-client[83360]: System call of process 95720 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:50 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=83, name=volume-d4552dde-187d-49d3-a03b-b6716782861f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:23:50 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:23:50 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:23:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Flow 'volume_create_manager' (f87dd663-d42a-4865-8c23-34e4187340f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:23:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e3822a-6f0d-4dc8-b161-6c5a6b02909f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d4552dde-187d-49d3-a03b-b6716782861f 1073741824" returned: 0 in 2.134s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d4552dde-187d-49d3-a03b-b6716782861f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e3822a-6f0d-4dc8-b161-6c5a6b02909f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1290760815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab66f2c3-5016-496c-a87d-a1f0bfbceb6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef178f4a7c2483c906954769df065c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:23:49Z,use_quota=True,user_id='2da8723098784ae5854fa51a0d7fa2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac67826-f299-47cf-9829-d44edc37821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac67826-f299-47cf-9829-d44edc37821b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10798ff0-fa24-4f44-953e-879ce76d4bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10798ff0-fa24-4f44-953e-879ce76d4bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab66f2c3-5016-496c-a87d-a1f0bfbceb6d', 'volume_name': 'volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db42683c-121e-4aaa-a569-0fb20ff407c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db42683c-121e-4aaa-a569-0fb20ff407c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68de4e9-b7a0-496f-abd8-0d3b53239a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:52 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume ab66f2c3-5016-496c-a87d-a1f0bfbceb6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d', 'volume_size': 1}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d4552dde-187d-49d3-a03b-b6716782861f" returned: 0 in 1.213s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] <== create_volume: return (3488ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.551s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.381s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1290760815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab66f2c3-5016-496c-a87d-a1f0bfbceb6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef178f4a7c2483c906954769df065c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:23:49Z,use_quota=True,user_id='2da8723098784ae5854fa51a0d7fa2c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Creating volume ab66f2c3-5016-496c-a87d-a1f0bfbceb6d {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:23:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:23:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:23:53 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:23:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:53 devstack quobyte-client[83360]: System call of process 95749 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:23:53 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=84, name=volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:23:53 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:23:53 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:23:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Flow 'volume_create_manager' (6e436bce-53db-44cc-8395-fdf3e43c7f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:23:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fe0ca5-5350-4b83-9b71-731a1d9a00f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92fe0ca5-5350-4b83-9b71-731a1d9a00f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1182324315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6585fd7d-9460-4bfe-820c-7732270161ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e09e144137477592f58df68593263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:23:51Z,use_quota=True,user_id='cb6b6b3a909b44afa722627c3adf111e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c961d566-aae7-472e-8e96-305f151dc428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c961d566-aae7-472e-8e96-305f151dc428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d4ca5b-37e1-487c-969e-c8b5bc198692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d4ca5b-37e1-487c-969e-c8b5bc198692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6585fd7d-9460-4bfe-820c-7732270161ac', 'volume_name': 'volume-6585fd7d-9460-4bfe-820c-7732270161ac', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c008f15e-7127-4d64-8771-ff842ae9f88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c008f15e-7127-4d64-8771-ff842ae9f88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dea53e9-b799-4325-8eca-731150a5162c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:55 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Volume 6585fd7d-9460-4bfe-820c-7732270161ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6585fd7d-9460-4bfe-820c-7732270161ac', 'volume_size': 1}
Sep 18 22:23:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811b1635-d665-4dba-bbf4-ce450a59ac08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4552dde-187d-49d3-a03b-b6716782861f', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edfaee39-02b1-4d35-a497-008694a4ed45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d 1073741824" returned: 0 in 2.639s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:56 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume volume-d4552dde-187d-49d3-a03b-b6716782861f (d4552dde-187d-49d3-a03b-b6716782861f): created successfully
Sep 18 22:23:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edfaee39-02b1-4d35-a497-008694a4ed45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Flow 'volume_create_manager' (7771fcb0-ba54-4b9e-a9ec-3ece571c3746) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:23:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d" returned: 0 in 0.783s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] <== create_volume: return (3525ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:23:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.577s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.976s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1182324315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6585fd7d-9460-4bfe-820c-7732270161ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e09e144137477592f58df68593263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:23:51Z,use_quota=True,user_id='cb6b6b3a909b44afa722627c3adf111e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:23:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Creating volume 6585fd7d-9460-4bfe-820c-7732270161ac {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:23:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:23:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:23:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:23:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:23:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:23:56 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:23:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6585fd7d-9460-4bfe-820c-7732270161ac 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:56 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=85, name=volume-6585fd7d-9460-4bfe-820c-7732270161ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:23:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68de4e9-b7a0-496f-abd8-0d3b53239a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0d442b-cab8-4920-a452-1ba5d6d8f16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:57 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-eb936bba-03e2-4d72-abb3-651ab29f9982 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Created volume successfully.
Sep 18 22:23:57 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d (ab66f2c3-5016-496c-a87d-a1f0bfbceb6d): created successfully
Sep 18 22:23:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab0d442b-cab8-4920-a452-1ba5d6d8f16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:57 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Flow 'volume_create_manager' (f87dd663-d42a-4865-8c23-34e4187340f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:23:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6585fd7d-9460-4bfe-820c-7732270161ac 1073741824" returned: 0 in 1.198s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6585fd7d-9460-4bfe-820c-7732270161ac {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:23:58 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a03618e7-78c0-4782-959d-a1a7a5b78f02 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Created volume successfully.
Sep 18 22:23:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6585fd7d-9460-4bfe-820c-7732270161ac" returned: 0 in 0.739s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:23:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] <== create_volume: return (2031ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:23:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:23:58 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dea53e9-b799-4325-8eca-731150a5162c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6585fd7d-9460-4bfe-820c-7732270161ac', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:58 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a04e055-81c3-4019-bad3-5851bb1360d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:23:58 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Volume volume-6585fd7d-9460-4bfe-820c-7732270161ac (6585fd7d-9460-4bfe-820c-7732270161ac): created successfully
Sep 18 22:23:58 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a04e055-81c3-4019-bad3-5851bb1360d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:23:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Flow 'volume_create_manager' (6e436bce-53db-44cc-8395-fdf3e43c7f86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:23:59 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e8a91acf-2b22-4a49-b050-619c4328a6d2 tempest-AttachVolumeTestJSON-1086341451 None] Created volume successfully.
Sep 18 22:24:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-662de4fe-ba1b-47cd-9674-241939ee5d13 req-89d55643-a0c6-4ad3-be62-f3aa7f604906 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:24:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-662de4fe-ba1b-47cd-9674-241939ee5d13 req-89d55643-a0c6-4ad3-be62-f3aa7f604906 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:24:03 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a09b49-3cc0-45ca-82d7-8386d4757c60]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:24:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-662de4fe-ba1b-47cd-9674-241939ee5d13 req-89d55643-a0c6-4ad3-be62-f3aa7f604906 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6585fd7d-9460-4bfe-820c-7732270161ac {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:24:05 devstack quobyte-client[83360]: System call of process 95821 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:24:05 devstack quobyte-client[83360]: System call of process 95821 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:24:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-662de4fe-ba1b-47cd-9674-241939ee5d13 req-89d55643-a0c6-4ad3-be62-f3aa7f604906 tempest-AttachVolumeTestJSON-1086341451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6585fd7d-9460-4bfe-820c-7732270161ac" returned: 0 in 1.348s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:24:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-662de4fe-ba1b-47cd-9674-241939ee5d13 req-89d55643-a0c6-4ad3-be62-f3aa7f604906 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.537s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:24:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-662de4fe-ba1b-47cd-9674-241939ee5d13 req-89d55643-a0c6-4ad3-be62-f3aa7f604906 tempest-AttachVolumeTestJSON-1086341451 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-6585fd7d-9460-4bfe-820c-7732270161ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81fa16e8-c6f1-4ec4-a53a-9eb036727901', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:24:05 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-662de4fe-ba1b-47cd-9674-241939ee5d13 req-89d55643-a0c6-4ad3-be62-f3aa7f604906 tempest-AttachVolumeTestJSON-1086341451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:24:05 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-662de4fe-ba1b-47cd-9674-241939ee5d13 req-89d55643-a0c6-4ad3-be62-f3aa7f604906 tempest-AttachVolumeTestJSON-1086341451 None] attachment_update completed successfully.
Sep 18 22:24:15 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=23,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:24:15 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=16,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:24:36 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-6cf77ef2-1aad-4dcc-b968-ff9efcd385e6 req-b2870b1e-15bf-49cf-b3a7-05d1401a6f82 tempest-AttachVolumeTestJSON-1086341451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:24:36 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-6cf77ef2-1aad-4dcc-b968-ff9efcd385e6 req-b2870b1e-15bf-49cf-b3a7-05d1401a6f82 tempest-AttachVolumeTestJSON-1086341451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:24:36 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-6cf77ef2-1aad-4dcc-b968-ff9efcd385e6 req-b2870b1e-15bf-49cf-b3a7-05d1401a6f82 tempest-AttachVolumeTestJSON-1086341451 None] Terminate volume connection completed successfully.
Sep 18 22:24:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-6cf77ef2-1aad-4dcc-b968-ff9efcd385e6 req-b2870b1e-15bf-49cf-b3a7-05d1401a6f82 tempest-AttachVolumeTestJSON-1086341451 None] Deleting attachment b42d63ec-d26d-4cd9-8b09-681da41c5b1f. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:24:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:24:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:24:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:24:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:24:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:24:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:24:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:24:47 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:24:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.238s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:24:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:25:01 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-95514d6d-36cf-4684-8ecd-a8fe6954d096 req-b65c0583-4bda-44b4-9449-a0a9db26b903 tempest-AttachVolumeTestJSON-1086341451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:25:01 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-95514d6d-36cf-4684-8ecd-a8fe6954d096 req-b65c0583-4bda-44b4-9449-a0a9db26b903 tempest-AttachVolumeTestJSON-1086341451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:25:01 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-95514d6d-36cf-4684-8ecd-a8fe6954d096 req-b65c0583-4bda-44b4-9449-a0a9db26b903 tempest-AttachVolumeTestJSON-1086341451 None] Terminate volume connection completed successfully.
Sep 18 22:25:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-95514d6d-36cf-4684-8ecd-a8fe6954d096 req-b65c0583-4bda-44b4-9449-a0a9db26b903 tempest-AttachVolumeTestJSON-1086341451 None] Deleting attachment 81fa16e8-c6f1-4ec4-a53a-9eb036727901. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:25:11 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:25:11 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:25:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "cinder-6585fd7d-9460-4bfe-820c-7732270161ac-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:25:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Lock "cinder-6585fd7d-9460-4bfe-820c-7732270161ac-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:25:16 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:25:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "cinder-quobyte-6585fd7d-9460-4bfe-820c-7732270161ac" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:25:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Lock "cinder-quobyte-6585fd7d-9460-4bfe-820c-7732270161ac" acquired by "delete_volume" :: waited 0.023s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:25:16 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ada06e-3fdf-4109-b5a4-20e218a5e72c]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:25:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6585fd7d-9460-4bfe-820c-7732270161ac {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:17 devstack quobyte-client[83360]: System call of process 96383 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:25:17 devstack quobyte-client[83360]: System call of process 96383 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:25:17 devstack quobyte-client[83360]: System call of process 96383 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:25:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6585fd7d-9460-4bfe-820c-7732270161ac" returned: 0 in 0.639s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6585fd7d-9460-4bfe-820c-7732270161ac {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6585fd7d-9460-4bfe-820c-7732270161ac" returned: 0 in 0.336s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:18 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Lock "cinder-quobyte-6585fd7d-9460-4bfe-820c-7732270161ac" released by "delete_volume" :: held 1.280s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:25:19 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Created reservations ['5b6f6889-1dee-43e1-8688-52bf8a51be1b', '24090a9d-39d3-4a81-a4ff-428226e70001', '25305958-3e4f-42aa-ac1b-15e5a5803fa0', '718b6330-2fb5-440d-a714-760bfbddf177'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:25:19 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-55395d3b-bebb-484d-a017-4a4eede9b32f req-1b5da4d4-105a-4f3c-8bfb-312c0162cea4 tempest-TestShelveInstance-1009296260 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:25:19 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-55395d3b-bebb-484d-a017-4a4eede9b32f req-1b5da4d4-105a-4f3c-8bfb-312c0162cea4 tempest-TestShelveInstance-1009296260 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:25:19 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-55395d3b-bebb-484d-a017-4a4eede9b32f req-1b5da4d4-105a-4f3c-8bfb-312c0162cea4 tempest-TestShelveInstance-1009296260 None] Terminate volume connection completed successfully.
Sep 18 22:25:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-55395d3b-bebb-484d-a017-4a4eede9b32f req-1b5da4d4-105a-4f3c-8bfb-312c0162cea4 tempest-TestShelveInstance-1009296260 None] Deleting attachment 72e2df12-3474-4d80-a386-4c4479af0e1b. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:25:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:25:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:25:19 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:25:19 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:25:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:25:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.177s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:19 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:25:20 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Deleted volume successfully.
Sep 18 22:25:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8e37de22-3142-4ac9-8b6a-e176d28fde06 tempest-AttachVolumeTestJSON-1086341451 None] Lock "cinder-6585fd7d-9460-4bfe-820c-7732270161ac-delete_volume" released by "delete_volume" :: held 3.515s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:25:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "cinder-c942947c-8cf3-4232-afa0-787c2dee7536-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:25:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Lock "cinder-c942947c-8cf3-4232-afa0-787c2dee7536-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:25:20 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:25:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "cinder-quobyte-c942947c-8cf3-4232-afa0-787c2dee7536" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:25:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Lock "cinder-quobyte-c942947c-8cf3-4232-afa0-787c2dee7536" acquired by "delete_volume" :: waited 0.046s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:25:20 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5ea7a0-e5be-45a5-9c7b-5ef404e16b79]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:25:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c942947c-8cf3-4232-afa0-787c2dee7536 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:21 devstack quobyte-client[83360]: System call of process 96431 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:25:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c942947c-8cf3-4232-afa0-787c2dee7536" returned: 0 in 0.676s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c942947c-8cf3-4232-afa0-787c2dee7536 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c942947c-8cf3-4232-afa0-787c2dee7536" returned: 0 in 0.259s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Lock "cinder-quobyte-c942947c-8cf3-4232-afa0-787c2dee7536" released by "delete_volume" :: held 1.233s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:25:22 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Created reservations ['5add5c02-1234-46dd-a30e-e19448841f28', 'ac66dab4-5275-4591-8f29-dca1f57ac145', '22bfb87f-b26a-49e5-a427-397a8bc88a3a', '53659945-2d36-4f49-9eeb-fcc66b076eba'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:25:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:25:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:25:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:25:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:25:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:25:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.136s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:22 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:25:22 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Deleted volume successfully.
Sep 18 22:25:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b2d27f9f-c202-4665-a47d-ee9eb0ac32d0 tempest-AttachVolumeTestJSON-1086341451 None] Lock "cinder-c942947c-8cf3-4232-afa0-787c2dee7536-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:25:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "cinder-8aa29d2c-32b6-49de-b330-73a4de529d5e-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:25:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Lock "cinder-8aa29d2c-32b6-49de-b330-73a4de529d5e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:25:23 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:25:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "cinder-quobyte-8aa29d2c-32b6-49de-b330-73a4de529d5e" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:25:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Lock "cinder-quobyte-8aa29d2c-32b6-49de-b330-73a4de529d5e" acquired by "delete_volume" :: waited 0.016s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:25:23 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc08716e-7f7a-4060-ab85-45d2ee403b74]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:25:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8aa29d2c-32b6-49de-b330-73a4de529d5e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8aa29d2c-32b6-49de-b330-73a4de529d5e" returned: 0 in 0.464s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8aa29d2c-32b6-49de-b330-73a4de529d5e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-8aa29d2c-32b6-49de-b330-73a4de529d5e" returned: 0 in 0.112s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:24 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Lock "cinder-quobyte-8aa29d2c-32b6-49de-b330-73a4de529d5e" released by "delete_volume" :: held 0.762s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:25:24 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Created reservations ['5b2af5e9-7b4c-4033-a5fb-739275940b1a', '211fad92-41ae-46a1-9847-e212b7550c9a', 'a887d7db-68d9-4340-8395-0c3df83d1a4c', 'c1f7c6fe-a6de-495a-8da1-5631df5bcc8b'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:25:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:25:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:25:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:25:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:25:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:25:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.140s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:24 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:25:24 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Deleted volume successfully.
Sep 18 22:25:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1f83d215-f444-48de-a3f2-152f4ff5a476 tempest-AttachVolumeTestJSON-1086341451 None] Lock "cinder-8aa29d2c-32b6-49de-b330-73a4de529d5e-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:25:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-6e42f890-2dab-4121-ae60-492676408dba req-6d8a9f15-3f0f-4cd9-98c2-96961656d80f tempest-TestShelveInstance-1009296260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:25:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-6e42f890-2dab-4121-ae60-492676408dba req-6d8a9f15-3f0f-4cd9-98c2-96961656d80f tempest-TestShelveInstance-1009296260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:25:25 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b5e58c-60e3-4472-8c38-21b947f2b7f0]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:25:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-6e42f890-2dab-4121-ae60-492676408dba req-6d8a9f15-3f0f-4cd9-98c2-96961656d80f tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:26 devstack quobyte-client[83360]: System call of process 96450 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:25:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-6e42f890-2dab-4121-ae60-492676408dba req-6d8a9f15-3f0f-4cd9-98c2-96961656d80f tempest-TestShelveInstance-1009296260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae" returned: 0 in 0.509s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-6e42f890-2dab-4121-ae60-492676408dba req-6d8a9f15-3f0f-4cd9-98c2-96961656d80f tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:27 devstack quobyte-client[83360]: System call of process 96452 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:25:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-6e42f890-2dab-4121-ae60-492676408dba req-6d8a9f15-3f0f-4cd9-98c2-96961656d80f tempest-TestShelveInstance-1009296260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae" returned: 1 in 0.599s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-6e42f890-2dab-4121-ae60-492676408dba req-6d8a9f15-3f0f-4cd9-98c2-96961656d80f tempest-TestShelveInstance-1009296260 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:25:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-6e42f890-2dab-4121-ae60-492676408dba req-6d8a9f15-3f0f-4cd9-98c2-96961656d80f tempest-TestShelveInstance-1009296260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.378s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:25:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-6e42f890-2dab-4121-ae60-492676408dba req-6d8a9f15-3f0f-4cd9-98c2-96961656d80f tempest-TestShelveInstance-1009296260 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-98b5711e-5028-4b98-93be-e10b1b0549ae', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98d7b609-e902-4cc3-90e9-635bc5fd6b23', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:25:27 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-6e42f890-2dab-4121-ae60-492676408dba req-6d8a9f15-3f0f-4cd9-98c2-96961656d80f tempest-TestShelveInstance-1009296260 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:25:27 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-6e42f890-2dab-4121-ae60-492676408dba req-6d8a9f15-3f0f-4cd9-98c2-96961656d80f tempest-TestShelveInstance-1009296260 None] attachment_update completed successfully.
Sep 18 22:25:35 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Flow 'volume_create_manager' (6727af8b-bb8f-455a-8f3d-4d624528034b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1317a4-46a4-4b4b-9442-d5cc8a8b327b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1317a4-46a4-4b4b-9442-d5cc8a8b327b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1541461769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9f723a-0386-4f59-8c31-e28de6de85bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ca88898e7f14a13b4ba0e76cba8eef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:25:35Z,use_quota=True,user_id='c6e5f6b728044dd78ceff635e56a3fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058d633d-74cd-477b-aa4d-11e74b6039cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058d633d-74cd-477b-aa4d-11e74b6039cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18ffc33-9de0-461c-80b6-3c28a5182a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18ffc33-9de0-461c-80b6-3c28a5182a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff9f723a-0386-4f59-8c31-e28de6de85bf', 'volume_name': 'volume-ff9f723a-0386-4f59-8c31-e28de6de85bf', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35a4043-c33a-4c67-8706-3dacf4c37ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f35a4043-c33a-4c67-8706-3dacf4c37ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79caa5f7-a143-4db7-b15f-9e2e258b37ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:25:35 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Volume ff9f723a-0386-4f59-8c31-e28de6de85bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff9f723a-0386-4f59-8c31-e28de6de85bf', 'volume_size': 1}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1541461769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9f723a-0386-4f59-8c31-e28de6de85bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ca88898e7f14a13b4ba0e76cba8eef0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:25:35Z,use_quota=True,user_id='c6e5f6b728044dd78ceff635e56a3fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Creating volume ff9f723a-0386-4f59-8c31-e28de6de85bf {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:25:35 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:25:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ff9f723a-0386-4f59-8c31-e28de6de85bf 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:36 devstack quobyte-client[83360]: System call of process 96467 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:25:36 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=86, name=volume-ff9f723a-0386-4f59-8c31-e28de6de85bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:25:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ff9f723a-0386-4f59-8c31-e28de6de85bf 1073741824" returned: 0 in 0.395s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ff9f723a-0386-4f59-8c31-e28de6de85bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ff9f723a-0386-4f59-8c31-e28de6de85bf" returned: 0 in 0.088s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] <== create_volume: return (593ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:25:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.609s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:25:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79caa5f7-a143-4db7-b15f-9e2e258b37ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff9f723a-0386-4f59-8c31-e28de6de85bf', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:25:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db630b43-eb2f-44b5-8079-a39a01e5ab37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:25:36 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Volume volume-ff9f723a-0386-4f59-8c31-e28de6de85bf (ff9f723a-0386-4f59-8c31-e28de6de85bf): created successfully
Sep 18 22:25:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db630b43-eb2f-44b5-8079-a39a01e5ab37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:25:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Flow 'volume_create_manager' (6727af8b-bb8f-455a-8f3d-4d624528034b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:25:36 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-fd9ea72a-ce8d-48a3-9450-9fda9a23b1b6 req-bd313f47-0216-423a-94c7-81cc539a5f31 tempest-VolumesGetTestJSON-1931086455 None] Created volume successfully.
Sep 18 22:25:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Acquiring lock "cinder-ff9f723a-0386-4f59-8c31-e28de6de85bf-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:25:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Lock "cinder-ff9f723a-0386-4f59-8c31-e28de6de85bf-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:25:38 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:25:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Acquiring lock "cinder-quobyte-ff9f723a-0386-4f59-8c31-e28de6de85bf" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:25:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Lock "cinder-quobyte-ff9f723a-0386-4f59-8c31-e28de6de85bf" acquired by "delete_volume" :: waited 0.019s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:25:38 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf8adeb-62ec-4282-93d9-16eee3682c8c]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:25:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ff9f723a-0386-4f59-8c31-e28de6de85bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ff9f723a-0386-4f59-8c31-e28de6de85bf" returned: 0 in 0.515s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ff9f723a-0386-4f59-8c31-e28de6de85bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ff9f723a-0386-4f59-8c31-e28de6de85bf" returned: 0 in 0.116s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:39 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Lock "cinder-quobyte-ff9f723a-0386-4f59-8c31-e28de6de85bf" released by "delete_volume" :: held 0.873s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:25:39 devstack cinder-volume[83342]: DEBUG cinder.quota [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Created reservations ['ac685d07-6d23-4efb-bf96-b952c20a6b75', 'a9635748-64d2-45ee-b77d-ec9f2715ae28', 'd9627ca7-8d77-4bbb-80a5-fdeabe5149dc', 'd63c0366-ba5b-4e43-ba15-966b767b76c4'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:25:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:25:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:25:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:25:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:25:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:25:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.189s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:40 devstack cinder-volume[83342]: DEBUG cinder.manager [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:25:40 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Deleted volume successfully.
Sep 18 22:25:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-e729dbe1-ad1e-4511-98c0-9375ed2845e3 req-8f9feffd-4bde-4f77-b851-66700d26aff6 tempest-VolumesGetTestJSON-1931086455 None] Lock "cinder-ff9f723a-0386-4f59-8c31-e28de6de85bf-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:25:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-7db234e0-70b7-4e02-b9b1-3546ac4a0e67 req-cc8951a7-b204-44b2-bc54-a10a146590c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:25:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-7db234e0-70b7-4e02-b9b1-3546ac4a0e67 req-cc8951a7-b204-44b2-bc54-a10a146590c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:25:40 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d7b759-320a-4bb0-9866-fcd1d496e69e]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:25:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-7db234e0-70b7-4e02-b9b1-3546ac4a0e67 req-cc8951a7-b204-44b2-bc54-a10a146590c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d4552dde-187d-49d3-a03b-b6716782861f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:41 devstack quobyte-client[83360]: System call of process 96555 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:25:41 devstack quobyte-client[83360]: System call of process 96555 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:25:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-7db234e0-70b7-4e02-b9b1-3546ac4a0e67 req-cc8951a7-b204-44b2-bc54-a10a146590c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d4552dde-187d-49d3-a03b-b6716782861f" returned: 0 in 0.527s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-7db234e0-70b7-4e02-b9b1-3546ac4a0e67 req-cc8951a7-b204-44b2-bc54-a10a146590c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.598s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:25:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-7db234e0-70b7-4e02-b9b1-3546ac4a0e67 req-cc8951a7-b204-44b2-bc54-a10a146590c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-d4552dde-187d-49d3-a03b-b6716782861f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b6ddca9-63ed-4dc9-8f9d-cb99d76f937b', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:25:41 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-7db234e0-70b7-4e02-b9b1-3546ac4a0e67 req-cc8951a7-b204-44b2-bc54-a10a146590c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:25:41 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-7db234e0-70b7-4e02-b9b1-3546ac4a0e67 req-cc8951a7-b204-44b2-bc54-a10a146590c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] attachment_update completed successfully.
Sep 18 22:25:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:25:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:25:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:25:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:25:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:25:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.087s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:25:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.760s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:25:51 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-3bd9202f-a0ec-42c5-a3b1-829f94f156ed tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:25:51 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-3bd9202f-a0ec-42c5-a3b1-829f94f156ed tempest-GroupSnapshotsTest-627094444 None] Group tempest-GroupSnapshotsTest-Group-1318534664: creating
Sep 18 22:25:51 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-3bd9202f-a0ec-42c5-a3b1-829f94f156ed tempest-GroupSnapshotsTest-627094444 None] Group tempest-GroupSnapshotsTest-Group-1318534664: created successfully
Sep 18 22:25:51 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-3bd9202f-a0ec-42c5-a3b1-829f94f156ed tempest-GroupSnapshotsTest-627094444 None] Create group completed successfully.
Sep 18 22:25:52 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:25:52 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:25:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Flow 'volume_create_manager' (03862a0d-2745-4270-bf69-a53d2a81bbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:25:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a582e0d-46f5-473e-8995-0cdc0e51af51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:25:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a582e0d-46f5-473e-8995-0cdc0e51af51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1382113865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9a02103e-a951-4f36-9614-05267c27aa5f,host='devstack@QuobyteHD#QuobyteHD',id=469e2793-795a-4721-9bdc-caa64995046e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6904e5e7ac4a4958a32b803c388a8796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:25:53Z,use_quota=True,user_id='305ff38ac5884534a90082acae8010ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65378cba-3cd7-49dc-8c5f-40057d8f6398),volume_type_id=65378cba-3cd7-49dc-8c5f-40057d8f6398)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:25:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ebfdd1-902a-4b9a-a4a6-c6272e675072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:25:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ebfdd1-902a-4b9a-a4a6-c6272e675072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:25:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408d1bcd-6825-4f49-8bda-951554e601d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:25:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408d1bcd-6825-4f49-8bda-951554e601d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '469e2793-795a-4721-9bdc-caa64995046e', 'volume_name': 'volume-469e2793-795a-4721-9bdc-caa64995046e', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:25:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e97ac0-c523-4152-a216-e2b7be51abd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:25:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e97ac0-c523-4152-a216-e2b7be51abd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:25:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a91c3aa-ec7d-4e07-b310-d7299007b3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:25:52 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Volume 469e2793-795a-4721-9bdc-caa64995046e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-469e2793-795a-4721-9bdc-caa64995046e', 'volume_size': 1}
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9a02103e-a951-4f36-9614-05267c27aa5f,created_at=2025-09-18T20:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1382113865',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9a02103e-a951-4f36-9614-05267c27aa5f,host='devstack@QuobyteHD#QuobyteHD',id=469e2793-795a-4721-9bdc-caa64995046e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6904e5e7ac4a4958a32b803c388a8796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:25:53Z,use_quota=True,user_id='305ff38ac5884534a90082acae8010ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65378cba-3cd7-49dc-8c5f-40057d8f6398),volume_type_id=65378cba-3cd7-49dc-8c5f-40057d8f6398)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Creating volume 469e2793-795a-4721-9bdc-caa64995046e {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:25:53 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:53 devstack quobyte-client[83360]: System call of process 96955 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:25:53 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=87, name=volume-469e2793-795a-4721-9bdc-caa64995046e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e 1073741824" returned: 0 in 0.480s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e" returned: 0 in 0.311s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] <== create_volume: return (894ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:25:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:25:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a91c3aa-ec7d-4e07-b310-d7299007b3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-469e2793-795a-4721-9bdc-caa64995046e', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:25:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76686841-f202-4824-9842-eb19e9fad83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:25:54 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Volume volume-469e2793-795a-4721-9bdc-caa64995046e (469e2793-795a-4721-9bdc-caa64995046e): created successfully
Sep 18 22:25:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76686841-f202-4824-9842-eb19e9fad83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:25:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Flow 'volume_create_manager' (03862a0d-2745-4270-bf69-a53d2a81bbaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:25:54 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-f0fec61e-a6df-4f64-bc3a-e3652eca76b0 tempest-GroupSnapshotsTest-627094444 None] Created volume successfully.
Sep 18 22:25:55 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] GroupSnapshot 54a7671a-af4f-4915-98a3-38aaea376e39: creating.
Sep 18 22:25:55 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:25:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] Group snapshot 54a7671a-af4f-4915-98a3-38aaea376e39: creating. {{(pid=83342) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 22:25:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:25:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:25:55 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] Creating offline snapshot eca3b680-fe23-4130-a1e5-6bbfa1fdc585 of volume 469e2793-795a-4721-9bdc-caa64995046e {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:25:55 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17482b4-1e5b-4dcc-9922-3e9be5e95ce9]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:25:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e" returned: 0 in 0.812s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:57 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=88, name=volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:25:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585 1G" returned: 0 in 0.529s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img rebase -u -b volume-469e2793-795a-4721-9bdc-caa64995046e -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:57 devstack quobyte-client[83360]: System call of process 96986 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:25:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img rebase -u -b volume-469e2793-795a-4721-9bdc-caa64995046e -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585" returned: 0 in 0.242s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:25:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585" returned: 0 in 0.271s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:25:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585" returned: 0 in 0.299s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.info" returned: 0 in 0.218s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:25:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:25:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.info" returned: 0 in 0.163s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:25:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.310s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:25:59 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-9d4490e9-282b-48dd-9515-7d5af2b7ae29 tempest-GroupSnapshotsTest-627094444 None] group_snapshot 54a7671a-af4f-4915-98a3-38aaea376e39: created successfully
Sep 18 22:26:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-8788b152-ef41-4a44-8487-11cbac7d1449 req-f263ec16-d974-4ecc-a7f9-44eb2258248d tempest-TestServerVolumeAttachmentScenario-1041188321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-8788b152-ef41-4a44-8487-11cbac7d1449 req-f263ec16-d974-4ecc-a7f9-44eb2258248d tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:00 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a19a18-5ca7-45cb-add9-5bbe22ff51de]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8788b152-ef41-4a44-8487-11cbac7d1449 req-f263ec16-d974-4ecc-a7f9-44eb2258248d tempest-TestServerVolumeAttachmentScenario-1041188321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-8788b152-ef41-4a44-8487-11cbac7d1449 req-f263ec16-d974-4ecc-a7f9-44eb2258248d tempest-TestServerVolumeAttachmentScenario-1041188321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d" returned: 0 in 0.680s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-8788b152-ef41-4a44-8487-11cbac7d1449 req-f263ec16-d974-4ecc-a7f9-44eb2258248d tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.761s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-8788b152-ef41-4a44-8487-11cbac7d1449 req-f263ec16-d974-4ecc-a7f9-44eb2258248d tempest-TestServerVolumeAttachmentScenario-1041188321 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15ec193a-ce67-415a-bbea-5f0dff4e8da5', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:26:01 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-8788b152-ef41-4a44-8487-11cbac7d1449 req-f263ec16-d974-4ecc-a7f9-44eb2258248d tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:01 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-8788b152-ef41-4a44-8487-11cbac7d1449 req-f263ec16-d974-4ecc-a7f9-44eb2258248d tempest-TestServerVolumeAttachmentScenario-1041188321 None] attachment_update completed successfully.
Sep 18 22:26:01 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "cinder-quobyte-eca3b680-fe23-4130-a1e5-6bbfa1fdc585-c03d4c25-e042-432d-a3b9-7a7c5f676d47" by "_create_volume_from_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-eca3b680-fe23-4130-a1e5-6bbfa1fdc585-c03d4c25-e042-432d-a3b9-7a7c5f676d47" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Creating volume c03d4c25-e042-432d-a3b9-7a7c5f676d47 from snapshot eca3b680-fe23-4130-a1e5-6bbfa1fdc585 {{(pid=83342) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "cinder-quobyte-c03d4c25-e042-432d-a3b9-7a7c5f676d47" by "_copy_volume_from_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-c03d4c25-e042-432d-a3b9-7a7c5f676d47" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] snapshot: eca3b680-fe23-4130-a1e5-6bbfa1fdc585, volume: c03d4c25-e042-432d-a3b9-7a7c5f676d47,  {{(pid=83342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4decf9a7-f639-4362-aec7-e5dd5dded9ad]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:02 devstack quobyte-client[83360]: System call of process 97032 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:02 devstack quobyte-client[83360]: System call of process 97032 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585" returned: 0 in 0.498s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-469e2793-795a-4721-9bdc-caa64995046e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:26:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e {{(pid=83342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 22:26:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Creating direct copy from snapshot {{(pid=83342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 22:26:02 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d37822-590a-4a11-86fd-d9d532ace03d]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:03 devstack quobyte-client[83360]: System call of process 97040 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e" returned: 0 in 0.778s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:03 devstack cinder-volume[83342]: DEBUG cinder.utils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c03d4c25-e042-432d-a3b9-7a7c5f676d47 not found in is_blk_device check {{(pid=83342) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 22:26:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c03d4c25-e042-432d-a3b9-7a7c5f676d47 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:03 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=90, name=volume-c03d4c25-e042-432d-a3b9-7a7c5f676d47, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:26:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c03d4c25-e042-432d-a3b9-7a7c5f676d47" returned: 0 in 7.172s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:10 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99c383e-2b2e-4a9e-9ee2-a13e82a69271]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:11 devstack quobyte-client[83360]: System call of process 97055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:11 devstack quobyte-client[83360]: System call of process 97055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e" returned: 0 in 0.699s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:11 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Image conversion details: src /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e, size 1024.00 MB, duration 7.23 sec, destination /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c03d4c25-e042-432d-a3b9-7a7c5f676d47 {{(pid=83342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 22:26:11 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Converted 1024.00 MB image at 141.67 MB/s
Sep 18 22:26:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c03d4c25-e042-432d-a3b9-7a7c5f676d47 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:26:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c03d4c25-e042-432d-a3b9-7a7c5f676d47 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c03d4c25-e042-432d-a3b9-7a7c5f676d47" returned: 0 in 0.099s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-c03d4c25-e042-432d-a3b9-7a7c5f676d47" released by "_copy_volume_from_snapshot" :: held 9.807s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:26:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-eca3b680-fe23-4130-a1e5-6bbfa1fdc585-c03d4c25-e042-432d-a3b9-7a7c5f676d47" released by "_create_volume_from_snapshot" :: held 9.843s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:26:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.899s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:11 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=44,cinder:SELECT=48,cinder:INSERT=13,cinder:DELETE=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:26:11 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=50,cinder:UPDATE=44,cinder:DELETE=4,cinder:INSERT=3 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:26:12 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-ea03e2c7-4f2c-40de-b807-7828b23bf6c4 tempest-GroupSnapshotsTest-627094444 None] Create group from source-snapshot-54a7671a-af4f-4915-98a3-38aaea376e39 completed successfully.
Sep 18 22:26:13 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "cinder-quobyte-c03d4c25-e042-432d-a3b9-7a7c5f676d47" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:26:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-c03d4c25-e042-432d-a3b9-7a7c5f676d47" acquired by "delete_volume" :: waited 0.052s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:26:13 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59ecfcf-742b-433f-80f1-ab2e4831d5e0]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c03d4c25-e042-432d-a3b9-7a7c5f676d47 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c03d4c25-e042-432d-a3b9-7a7c5f676d47" returned: 0 in 0.402s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c03d4c25-e042-432d-a3b9-7a7c5f676d47 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c03d4c25-e042-432d-a3b9-7a7c5f676d47" returned: 0 in 0.144s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-c03d4c25-e042-432d-a3b9-7a7c5f676d47" released by "delete_volume" :: held 0.725s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:26:14 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Created reservations ['bdd2561f-899e-4251-815b-9655fc94e4dd'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:26:14 devstack cinder-volume[83342]: WARNING cinder.quota [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1979527619 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1979527619, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:26:14 devstack cinder-volume[83342]: WARNING cinder.quota [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1979527619 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1979527619, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:26:14 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Created reservations ['d506305e-53c1-4de9-925c-5f069dd04fe7', '7db6bd8a-bacd-4a8b-9509-4b4f758ba171', 'bc4a300e-5864-44aa-9cf8-dd816e340ea6', '1e24f55a-8f88-4dbd-a60f-a8b265c3aa7e'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:26:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:26:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:26:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.129s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:14 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:26:14 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-71a80a9d-f41f-4e3d-bf54-5d05cbda9a56 tempest-GroupSnapshotsTest-627094444 None] Delete group completed successfully.
Sep 18 22:26:15 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] group_snapshot 54a7671a-af4f-4915-98a3-38aaea376e39: deleting
Sep 18 22:26:15 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] group_snapshot 54a7671a-af4f-4915-98a3-38aaea376e39: deleting {{(pid=83342) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 22:26:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "cinder-quobyte-469e2793-795a-4721-9bdc-caa64995046e" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:26:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-469e2793-795a-4721-9bdc-caa64995046e" acquired by "delete_snapshot" :: waited 0.057s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:26:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "cinder-quobyte-eca3b680-fe23-4130-a1e5-6bbfa1fdc585" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:26:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-eca3b680-fe23-4130-a1e5-6bbfa1fdc585" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:26:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] Deleting offline snapshot eca3b680-fe23-4130-a1e5-6bbfa1fdc585 of volume 469e2793-795a-4721-9bdc-caa64995046e {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:26:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] snapshot_file for this snap is: volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:26:15 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd95666-0273-4cfc-922a-083b9aac68b1]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585" returned: 0 in 0.439s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-469e2793-795a-4721-9bdc-caa64995046e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:26:16 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f74991-c556-4c26-9b9e-a2e6c77044c3]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e" returned: 0 in 0.470s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:17 devstack quobyte-client[83360]: System call of process 97076 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585" returned: 0 in 0.227s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e.eca3b680-fe23-4130-a1e5-6bbfa1fdc585" returned: 0 in 0.100s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-eca3b680-fe23-4130-a1e5-6bbfa1fdc585" released by "_delete_snapshot" :: held 1.602s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:26:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-469e2793-795a-4721-9bdc-caa64995046e" released by "delete_snapshot" :: held 1.638s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:26:17 devstack cinder-volume[83342]: WARNING cinder.quota [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1979527619 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1979527619, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:26:17 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] Created reservations ['ea41aa34-6006-4313-8b10-377271662c87', '0227b6f5-fa17-4027-b1e9-9b457e03f379', '8c265484-1447-42eb-9e06-b91419ba7ebe', 'cce5109f-d70f-4cc6-a8cc-c6bd14e3a9a1'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:26:18 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-81680e4d-875e-4262-bf1d-a7c3f9e24b0e tempest-GroupSnapshotsTest-627094444 None] group_snapshot 54a7671a-af4f-4915-98a3-38aaea376e39: deleted successfully
Sep 18 22:26:19 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:19 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "cinder-quobyte-469e2793-795a-4721-9bdc-caa64995046e" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:26:19 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-469e2793-795a-4721-9bdc-caa64995046e" acquired by "delete_volume" :: waited 0.029s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:26:19 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c66ebb3-530c-43a7-9206-aa72db251420]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:19 devstack quobyte-client[83360]: System call of process 97080 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e" returned: 0 in 0.532s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-469e2793-795a-4721-9bdc-caa64995046e" returned: 0 in 0.151s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-469e2793-795a-4721-9bdc-caa64995046e" released by "delete_volume" :: held 0.920s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:26:20 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Created reservations ['01c15b9c-b30b-45f7-b3de-7e9d74112e88'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:26:20 devstack cinder-volume[83342]: WARNING cinder.db.sqlalchemy.api [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1979527619']
Sep 18 22:26:20 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Created reservations ['67ca2ea9-379c-4177-b48b-11e4daccc78e', '8214439e-4ada-4409-aa05-a867c0b9352b', 'c761a571-bb4e-40ff-8de8-501c55764cc0', '32315df9-3141-4746-87a9-421de16a092b'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:26:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:26:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:26:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.120s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:21 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:26:21 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-4ee40ac2-b7da-4fa1-b2f0-8f20c0880df5 tempest-GroupSnapshotsTest-627094444 None] Delete group completed successfully.
Sep 18 22:26:22 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-de5ff085-bf76-4d34-9493-66868e39ccb6 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:22 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-de5ff085-bf76-4d34-9493-66868e39ccb6 tempest-GroupSnapshotsTest-627094444 None] Group tempest-GroupSnapshotsTest-Group-814708816: creating
Sep 18 22:26:22 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-de5ff085-bf76-4d34-9493-66868e39ccb6 tempest-GroupSnapshotsTest-627094444 None] Group tempest-GroupSnapshotsTest-Group-814708816: created successfully
Sep 18 22:26:22 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-de5ff085-bf76-4d34-9493-66868e39ccb6 tempest-GroupSnapshotsTest-627094444 None] Create group completed successfully.
Sep 18 22:26:23 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:23 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:26:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Flow 'volume_create_manager' (5f35cb2d-d007-4850-8722-983bbe046408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:26:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d21bce2-bc38-4a20-8a80-fc479b247ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d21bce2-bc38-4a20-8a80-fc479b247ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-414785377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=661a4d18-cea1-4a2f-9040-51af5478ccd0,host='devstack@QuobyteHD#QuobyteHD',id=5e815924-ba2a-4f61-802b-30363ee2ab89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6904e5e7ac4a4958a32b803c388a8796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:26:24Z,use_quota=True,user_id='305ff38ac5884534a90082acae8010ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f6d2226-b849-4cf6-9243-460767a44451),volume_type_id=4f6d2226-b849-4cf6-9243-460767a44451)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d014bf4-f8be-4a55-ad30-bbb54826765c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d014bf4-f8be-4a55-ad30-bbb54826765c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87147bd7-0022-49e9-a427-fd12599e1a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:23 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87147bd7-0022-49e9-a427-fd12599e1a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e815924-ba2a-4f61-802b-30363ee2ab89', 'volume_name': 'volume-5e815924-ba2a-4f61-802b-30363ee2ab89', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8012e3b9-d9a7-4048-a19f-9a5376c697d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8012e3b9-d9a7-4048-a19f-9a5376c697d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeef20f5-33b1-4a9d-99e8-f83719a5a8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:24 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Volume 5e815924-ba2a-4f61-802b-30363ee2ab89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e815924-ba2a-4f61-802b-30363ee2ab89', 'volume_size': 1}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=661a4d18-cea1-4a2f-9040-51af5478ccd0,created_at=2025-09-18T20:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-414785377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=661a4d18-cea1-4a2f-9040-51af5478ccd0,host='devstack@QuobyteHD#QuobyteHD',id=5e815924-ba2a-4f61-802b-30363ee2ab89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6904e5e7ac4a4958a32b803c388a8796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:26:24Z,use_quota=True,user_id='305ff38ac5884534a90082acae8010ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f6d2226-b849-4cf6-9243-460767a44451),volume_type_id=4f6d2226-b849-4cf6-9243-460767a44451)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Creating volume 5e815924-ba2a-4f61-802b-30363ee2ab89 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:26:24 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:24 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=91, name=volume-5e815924-ba2a-4f61-802b-30363ee2ab89, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89 1073741824" returned: 0 in 0.374s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89" returned: 0 in 0.102s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] <== create_volume: return (565ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.581s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeef20f5-33b1-4a9d-99e8-f83719a5a8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e815924-ba2a-4f61-802b-30363ee2ab89', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac126d64-b489-44a5-86b6-37cb63a0cefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:24 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Volume volume-5e815924-ba2a-4f61-802b-30363ee2ab89 (5e815924-ba2a-4f61-802b-30363ee2ab89): created successfully
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac126d64-b489-44a5-86b6-37cb63a0cefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:24 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Flow 'volume_create_manager' (5f35cb2d-d007-4850-8722-983bbe046408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:26:24 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-ca873917-189c-4444-afdb-a52aac156773 tempest-GroupSnapshotsTest-627094444 None] Created volume successfully.
Sep 18 22:26:26 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:26 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:26:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Flow 'volume_create_manager' (70df507f-3a1e-4804-8314-982763c2e506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:26:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3ddb23-f5d0-4d43-bc52-61fe9a8b3145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3ddb23-f5d0-4d43-bc52-61fe9a8b3145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-679591291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=661a4d18-cea1-4a2f-9040-51af5478ccd0,host='devstack@QuobyteHD#QuobyteHD',id=938487ff-62b7-418c-8ae9-3888583a524f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6904e5e7ac4a4958a32b803c388a8796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:26:27Z,use_quota=True,user_id='305ff38ac5884534a90082acae8010ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f6d2226-b849-4cf6-9243-460767a44451),volume_type_id=4f6d2226-b849-4cf6-9243-460767a44451)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d572fa3-41c4-4e34-8bdb-3661da6ff7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d572fa3-41c4-4e34-8bdb-3661da6ff7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0e2f61-17ae-44ca-a122-45870712bd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b0e2f61-17ae-44ca-a122-45870712bd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '938487ff-62b7-418c-8ae9-3888583a524f', 'volume_name': 'volume-938487ff-62b7-418c-8ae9-3888583a524f', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1572a201-0829-47cc-a1a0-4fbc287f44c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1572a201-0829-47cc-a1a0-4fbc287f44c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d2f7a0-c0b0-470f-8344-ebe3e456992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:27 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Volume 938487ff-62b7-418c-8ae9-3888583a524f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-938487ff-62b7-418c-8ae9-3888583a524f', 'volume_size': 1}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=661a4d18-cea1-4a2f-9040-51af5478ccd0,created_at=2025-09-18T20:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-679591291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=661a4d18-cea1-4a2f-9040-51af5478ccd0,host='devstack@QuobyteHD#QuobyteHD',id=938487ff-62b7-418c-8ae9-3888583a524f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6904e5e7ac4a4958a32b803c388a8796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:26:27Z,use_quota=True,user_id='305ff38ac5884534a90082acae8010ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f6d2226-b849-4cf6-9243-460767a44451),volume_type_id=4f6d2226-b849-4cf6-9243-460767a44451)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Creating volume 938487ff-62b7-418c-8ae9-3888583a524f {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:26:27 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:27 devstack quobyte-client[83360]: System call of process 97126 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:27 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=92, name=volume-938487ff-62b7-418c-8ae9-3888583a524f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f 1073741824" returned: 0 in 0.481s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f" returned: 0 in 0.134s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] <== create_volume: return (713ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:26:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d2f7a0-c0b0-470f-8344-ebe3e456992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-938487ff-62b7-418c-8ae9-3888583a524f', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4a75b7-a369-4d15-bc87-353d2916eb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:28 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Volume volume-938487ff-62b7-418c-8ae9-3888583a524f (938487ff-62b7-418c-8ae9-3888583a524f): created successfully
Sep 18 22:26:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a4a75b7-a369-4d15-bc87-353d2916eb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Flow 'volume_create_manager' (70df507f-3a1e-4804-8314-982763c2e506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:26:28 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-27092f88-b5a6-4201-9452-e8401f70b14b tempest-GroupSnapshotsTest-627094444 None] Created volume successfully.
Sep 18 22:26:29 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-beac5581-59fa-4baf-a5c3-7361be064f9a tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:29 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-beac5581-59fa-4baf-a5c3-7361be064f9a tempest-GroupSnapshotsTest-627094444 None] Update group completed successfully.
Sep 18 22:26:30 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-27fe4dfd-2f55-4843-adb7-7305c96622d6 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:30 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-27fe4dfd-2f55-4843-adb7-7305c96622d6 tempest-GroupSnapshotsTest-627094444 None] Update group completed successfully.
Sep 18 22:26:32 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-81924db1-6d93-4447-b85c-f021321a3a26 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:32 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-81924db1-6d93-4447-b85c-f021321a3a26 tempest-GroupSnapshotsTest-627094444 None] Update group completed successfully.
Sep 18 22:26:33 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-0cccc7e7-7e1d-46d6-8537-6016ff5d90a1 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:33 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-0cccc7e7-7e1d-46d6-8537-6016ff5d90a1 tempest-GroupSnapshotsTest-627094444 None] Update group completed successfully.
Sep 18 22:26:33 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-9324a2f9-f4a5-47d6-b7e3-aba556aa2ede req-552838f9-3157-4f93-b1e1-af9e5d5d32ea tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:33 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-9324a2f9-f4a5-47d6-b7e3-aba556aa2ede req-552838f9-3157-4f93-b1e1-af9e5d5d32ea tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:33 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-9324a2f9-f4a5-47d6-b7e3-aba556aa2ede req-552838f9-3157-4f93-b1e1-af9e5d5d32ea tempest-TestServerVolumeAttachmentScenario-1041188321 None] Terminate volume connection completed successfully.
Sep 18 22:26:33 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-9324a2f9-f4a5-47d6-b7e3-aba556aa2ede req-552838f9-3157-4f93-b1e1-af9e5d5d32ea tempest-TestServerVolumeAttachmentScenario-1041188321 None] Deleting attachment 15ec193a-ce67-415a-bbea-5f0dff4e8da5. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:26:34 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] GroupSnapshot b9077a7b-e3bd-4ce1-8d73-6727fb9510ce: creating.
Sep 18 22:26:34 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:34 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Group snapshot b9077a7b-e3bd-4ce1-8d73-6727fb9510ce: creating. {{(pid=83342) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 22:26:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:34 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Creating offline snapshot 7bb9bf17-a027-4811-aada-94325fd15e8b of volume 938487ff-62b7-418c-8ae9-3888583a524f {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:26:34 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3c9dce-0d81-4049-890e-ec51f0b2434b]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:35 devstack quobyte-client[83360]: System call of process 97138 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f" returned: 0 in 0.456s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:35 devstack quobyte-client[83360]: System call of process 97141 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:35 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=93, name=volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:26:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b 1G" returned: 0 in 0.286s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img rebase -u -b volume-938487ff-62b7-418c-8ae9-3888583a524f -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:35 devstack quobyte-client[83360]: System call of process 97144 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img rebase -u -b volume-938487ff-62b7-418c-8ae9-3888583a524f -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b" returned: 0 in 0.182s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:26:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b" returned: 0 in 0.107s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:26:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b" returned: 0 in 0.083s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.info" returned: 0 in 0.089s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:26:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.info" returned: 0 in 0.080s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.578s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Creating offline snapshot 81be69b8-784e-48b9-8e3d-27fc9d953df0 of volume 5e815924-ba2a-4f61-802b-30363ee2ab89 {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:26:36 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43c8317-dfda-41f9-9b6c-23a3c580ad8b]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89" returned: 0 in 0.462s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:37 devstack quobyte-client[83360]: System call of process 97155 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:37 devstack quobyte-client[83360]: System call of process 97155 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:37 devstack quobyte-client[83360]: System call of process 97155 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:37 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=95, name=volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:26:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0 1G" returned: 0 in 0.291s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img rebase -u -b volume-5e815924-ba2a-4f61-802b-30363ee2ab89 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:37 devstack quobyte-client[83360]: System call of process 97160 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:37 devstack quobyte-client[83360]: System call of process 97160 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:37 devstack quobyte-client[83360]: System call of process 97160 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img rebase -u -b volume-5e815924-ba2a-4f61-802b-30363ee2ab89 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0" returned: 0 in 0.219s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:26:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0" returned: 0 in 0.115s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:26:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0" returned: 0 in 0.126s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.info" returned: 0 in 0.105s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:26:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.info" returned: 0 in 0.090s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.907s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:38 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-6d66cbc5-9a7a-49b3-8b26-380e04f77fda tempest-GroupSnapshotsTest-627094444 None] group_snapshot b9077a7b-e3bd-4ce1-8d73-6727fb9510ce: created successfully
Sep 18 22:26:39 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] group_snapshot b9077a7b-e3bd-4ce1-8d73-6727fb9510ce: deleting
Sep 18 22:26:39 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] group_snapshot b9077a7b-e3bd-4ce1-8d73-6727fb9510ce: deleting {{(pid=83342) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 22:26:39 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "cinder-quobyte-938487ff-62b7-418c-8ae9-3888583a524f" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:26:39 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-938487ff-62b7-418c-8ae9-3888583a524f" acquired by "delete_snapshot" :: waited 0.079s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:26:39 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "cinder-quobyte-7bb9bf17-a027-4811-aada-94325fd15e8b" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:26:39 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-7bb9bf17-a027-4811-aada-94325fd15e8b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:26:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Deleting offline snapshot 7bb9bf17-a027-4811-aada-94325fd15e8b of volume 938487ff-62b7-418c-8ae9-3888583a524f {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:26:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] snapshot_file for this snap is: volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:26:39 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[467cf0ab-f715-4adb-8f62-45f6194c72c3]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b" returned: 0 in 0.422s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-938487ff-62b7-418c-8ae9-3888583a524f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:26:39 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b50e724-82d7-4233-becb-f10cb10c7243]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:40 devstack quobyte-client[83360]: System call of process 97171 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:40 devstack quobyte-client[83360]: System call of process 97171 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:40 devstack quobyte-client[83360]: System call of process 97171 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f" returned: 0 in 0.513s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:40 devstack quobyte-client[83360]: System call of process 97175 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:40 devstack quobyte-client[83360]: System call of process 97175 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:40 devstack quobyte-client[83360]: System call of process 97175 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b" returned: 0 in 0.234s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f.7bb9bf17-a027-4811-aada-94325fd15e8b" returned: 0 in 0.122s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-7bb9bf17-a027-4811-aada-94325fd15e8b" released by "_delete_snapshot" :: held 1.637s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:26:40 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-938487ff-62b7-418c-8ae9-3888583a524f" released by "delete_snapshot" :: held 1.671s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:26:41 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "cinder-quobyte-5e815924-ba2a-4f61-802b-30363ee2ab89" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:26:41 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-5e815924-ba2a-4f61-802b-30363ee2ab89" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:26:41 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "cinder-quobyte-81be69b8-784e-48b9-8e3d-27fc9d953df0" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:26:41 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-81be69b8-784e-48b9-8e3d-27fc9d953df0" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:26:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Deleting offline snapshot 81be69b8-784e-48b9-8e3d-27fc9d953df0 of volume 5e815924-ba2a-4f61-802b-30363ee2ab89 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:26:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] snapshot_file for this snap is: volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:26:41 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09707e4-36ca-4d83-adbe-0f6d1e60f316]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:41 devstack quobyte-client[83360]: System call of process 97180 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0" returned: 0 in 0.449s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e815924-ba2a-4f61-802b-30363ee2ab89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:26:41 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad353665-7568-4209-b153-c090815feeb7]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:42 devstack quobyte-client[83360]: System call of process 97185 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89" returned: 0 in 0.455s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:42 devstack quobyte-client[83360]: System call of process 97190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:42 devstack quobyte-client[83360]: System call of process 97190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:42 devstack quobyte-client[83360]: System call of process 97190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:42 devstack quobyte-client[83360]: System call of process 97190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:42 devstack quobyte-client[83360]: System call of process 97190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0" returned: 0 in 0.222s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89.81be69b8-784e-48b9-8e3d-27fc9d953df0" returned: 0 in 0.105s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:42 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-81be69b8-784e-48b9-8e3d-27fc9d953df0" released by "_delete_snapshot" :: held 1.575s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:26:42 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-5e815924-ba2a-4f61-802b-30363ee2ab89" released by "delete_snapshot" :: held 1.598s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:26:43 devstack cinder-volume[83342]: WARNING cinder.quota [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1442838132 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1442838132, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:26:43 devstack cinder-volume[83342]: WARNING cinder.quota [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1442838132 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1442838132, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:26:43 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Created reservations ['0a8fb4be-ee3a-4888-97c5-ca4bb2e5e0ca', 'b8f43cb4-04b3-49a7-baac-f2f2e91d7894', 'c1d915e8-4e01-41d8-a8dd-8cc3375b3227', 'f0d5e70d-c9b7-4bc2-9432-3b5600667b54'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:26:43 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] Created reservations ['0004c583-bf63-415f-811f-d88bdabc761d', '9b4c23e3-bfd3-4da8-82f4-335385e0892d', '64b799de-048c-4bf6-863c-da1d1fdded81', '89f12425-1faa-410f-8f81-df83f93f64a3'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:26:43 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-b0229739-970a-43ba-a10b-50362cc71835 tempest-GroupSnapshotsTest-627094444 None] group_snapshot b9077a7b-e3bd-4ce1-8d73-6727fb9510ce: deleted successfully
Sep 18 22:26:43 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:43 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "cinder-quobyte-5e815924-ba2a-4f61-802b-30363ee2ab89" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:26:43 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-5e815924-ba2a-4f61-802b-30363ee2ab89" acquired by "delete_volume" :: waited 0.023s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:26:43 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2a1fb7-56db-4afb-bee9-c202d71c7b7f]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:44 devstack quobyte-client[83360]: System call of process 97199 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89" returned: 0 in 0.488s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5e815924-ba2a-4f61-802b-30363ee2ab89" returned: 0 in 0.108s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:44 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-5e815924-ba2a-4f61-802b-30363ee2ab89" released by "delete_volume" :: held 0.784s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:26:44 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "cinder-quobyte-938487ff-62b7-418c-8ae9-3888583a524f" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:26:44 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-938487ff-62b7-418c-8ae9-3888583a524f" acquired by "delete_volume" :: waited 0.024s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:26:44 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e2bd68-718b-43c8-aa1b-2ffcbfac1f61]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:45 devstack quobyte-client[83360]: System call of process 97206 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f" returned: 0 in 0.462s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-938487ff-62b7-418c-8ae9-3888583a524f" returned: 0 in 0.114s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-938487ff-62b7-418c-8ae9-3888583a524f" released by "delete_volume" :: held 0.759s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:26:45 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Created reservations ['1d6f0d70-d98e-495b-a85f-c7ce9083fde2'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:26:45 devstack cinder-volume[83342]: WARNING cinder.quota [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1442838132 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1442838132, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:26:45 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Created reservations ['0ffa74e0-59c9-475a-8eae-cb2219eaa63c', '51e55e19-32e4-41a7-b646-95ba03f79be0', 'd832bbd8-7a80-457d-82f2-967c887acc2d', '8ab9b0b9-1592-408a-a4c1-61a447543f78'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Created reservations ['d8aef46e-78ff-4a1f-92f3-824b650bb22a', '159553fe-9c21-4837-906a-683cf44e6cc8', '80190d56-4fd6-46df-b03d-cea9bcb8bcd8', '66988a8c-7618-48e9-9079-25e4a9df29c2'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.090s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:26:46 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-eeba595f-2df1-4c77-b338-91c26d5ae3ff tempest-GroupSnapshotsTest-627094444 None] Delete group completed successfully.
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.090s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:26:48 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-baef9e1b-40f2-4803-8ba0-30ba13bc4f58 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:48 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-baef9e1b-40f2-4803-8ba0-30ba13bc4f58 tempest-GroupSnapshotsTest-627094444 None] Group tempest-GroupSnapshotsTest-Group-1066029017: creating
Sep 18 22:26:48 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-baef9e1b-40f2-4803-8ba0-30ba13bc4f58 tempest-GroupSnapshotsTest-627094444 None] Group tempest-GroupSnapshotsTest-Group-1066029017: created successfully
Sep 18 22:26:48 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-baef9e1b-40f2-4803-8ba0-30ba13bc4f58 tempest-GroupSnapshotsTest-627094444 None] Create group completed successfully.
Sep 18 22:26:49 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Flow 'volume_create_manager' (b49d1f87-ca24-46cf-bf1f-31f3eed365cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553531a8-1867-4679-b4d7-093addface5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553531a8-1867-4679-b4d7-093addface5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1524993285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=765341dc-82b0-4fd3-b359-f8a085e61936,host='devstack@QuobyteHD#QuobyteHD',id=241f341a-f4e7-4921-95a6-4aa83af6b097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6904e5e7ac4a4958a32b803c388a8796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:26:49Z,use_quota=True,user_id='305ff38ac5884534a90082acae8010ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdd20d47-c23a-4fdf-8050-6ceb2ef794f8),volume_type_id=cdd20d47-c23a-4fdf-8050-6ceb2ef794f8)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a812d3b9-d3f4-418d-87d3-945459eabe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a812d3b9-d3f4-418d-87d3-945459eabe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51aebd15-9d54-4180-af67-7a21c578bd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51aebd15-9d54-4180-af67-7a21c578bd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '241f341a-f4e7-4921-95a6-4aa83af6b097', 'volume_name': 'volume-241f341a-f4e7-4921-95a6-4aa83af6b097', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d690b3-dda2-474e-982f-464baaa7d341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73d690b3-dda2-474e-982f-464baaa7d341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ed63e3-df79-4d0e-bc5e-fbad1d6a4b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:49 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Volume 241f341a-f4e7-4921-95a6-4aa83af6b097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-241f341a-f4e7-4921-95a6-4aa83af6b097', 'volume_size': 1}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=765341dc-82b0-4fd3-b359-f8a085e61936,created_at=2025-09-18T20:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1524993285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=765341dc-82b0-4fd3-b359-f8a085e61936,host='devstack@QuobyteHD#QuobyteHD',id=241f341a-f4e7-4921-95a6-4aa83af6b097,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6904e5e7ac4a4958a32b803c388a8796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:26:49Z,use_quota=True,user_id='305ff38ac5884534a90082acae8010ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdd20d47-c23a-4fdf-8050-6ceb2ef794f8),volume_type_id=cdd20d47-c23a-4fdf-8050-6ceb2ef794f8)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Creating volume 241f341a-f4e7-4921-95a6-4aa83af6b097 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:26:49 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:26:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:49 devstack quobyte-client[83360]: System call of process 97216 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:49 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=97, name=volume-241f341a-f4e7-4921-95a6-4aa83af6b097, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:26:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097 1073741824" returned: 0 in 0.377s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097" returned: 0 in 0.097s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] <== create_volume: return (558ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:26:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.574s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74ed63e3-df79-4d0e-bc5e-fbad1d6a4b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-241f341a-f4e7-4921-95a6-4aa83af6b097', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ab7293-f980-414f-aa7f-04899cec7145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:26:50 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Volume volume-241f341a-f4e7-4921-95a6-4aa83af6b097 (241f341a-f4e7-4921-95a6-4aa83af6b097): created successfully
Sep 18 22:26:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ab7293-f980-414f-aa7f-04899cec7145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:26:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Flow 'volume_create_manager' (b49d1f87-ca24-46cf-bf1f-31f3eed365cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:26:50 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-6bdeb745-a683-4cd1-9d5e-8d2b6e0a7489 tempest-GroupSnapshotsTest-627094444 None] Created volume successfully.
Sep 18 22:26:51 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] GroupSnapshot afe34113-b394-4cda-b348-d603b5542be3: creating.
Sep 18 22:26:51 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] Group snapshot afe34113-b394-4cda-b348-d603b5542be3: creating. {{(pid=83342) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 18 22:26:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:26:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:26:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] Creating offline snapshot f7102647-67c8-4ba6-bb70-c3ae319581ec of volume 241f341a-f4e7-4921-95a6-4aa83af6b097 {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:26:52 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c1daf3-731f-488b-aed6-d31d095c0d60]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097" returned: 0 in 0.441s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:52 devstack quobyte-client[83360]: System call of process 97224 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:52 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=98, name=volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:26:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec 1G" returned: 0 in 0.293s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img rebase -u -b volume-241f341a-f4e7-4921-95a6-4aa83af6b097 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:53 devstack quobyte-client[83360]: System call of process 97227 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img rebase -u -b volume-241f341a-f4e7-4921-95a6-4aa83af6b097 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec" returned: 0 in 0.187s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:26:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec" returned: 0 in 0.109s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:26:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec" returned: 0 in 0.090s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.info" returned: 0 in 0.104s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:26:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.info" returned: 0 in 0.143s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.712s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:26:54 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-ce266096-a505-4c49-a7ce-ee0edfb07e40 tempest-GroupSnapshotsTest-627094444 None] group_snapshot afe34113-b394-4cda-b348-d603b5542be3: created successfully
Sep 18 22:26:54 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] group_snapshot afe34113-b394-4cda-b348-d603b5542be3: deleting
Sep 18 22:26:54 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] group_snapshot afe34113-b394-4cda-b348-d603b5542be3: deleting {{(pid=83342) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 18 22:26:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "cinder-quobyte-241f341a-f4e7-4921-95a6-4aa83af6b097" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:26:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-241f341a-f4e7-4921-95a6-4aa83af6b097" acquired by "delete_snapshot" :: waited 0.082s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:26:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "cinder-quobyte-f7102647-67c8-4ba6-bb70-c3ae319581ec" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:26:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-f7102647-67c8-4ba6-bb70-c3ae319581ec" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:26:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Deleting offline snapshot f7102647-67c8-4ba6-bb70-c3ae319581ec of volume 241f341a-f4e7-4921-95a6-4aa83af6b097 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:26:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] snapshot_file for this snap is: volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:26:54 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f846d62b-dcb1-459c-be34-560d76700d49]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:55 devstack quobyte-client[83360]: System call of process 97234 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec" returned: 0 in 0.428s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:55 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-241f341a-f4e7-4921-95a6-4aa83af6b097(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:26:55 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c83395-ce09-4b98-b2a9-0b35178350fc]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097" returned: 0 in 0.439s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:55 devstack quobyte-client[83360]: System call of process 97244 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec" returned: 0 in 0.238s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097.f7102647-67c8-4ba6-bb70-c3ae319581ec" returned: 0 in 0.105s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:26:56 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-f7102647-67c8-4ba6-bb70-c3ae319581ec" released by "_delete_snapshot" :: held 1.589s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:26:56 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-241f341a-f4e7-4921-95a6-4aa83af6b097" released by "delete_snapshot" :: held 1.636s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:26:56 devstack cinder-volume[83342]: WARNING cinder.quota [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1824111246 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1824111246, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:26:56 devstack cinder-volume[83342]: WARNING cinder.quota [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1824111246 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1824111246, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:26:56 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] Created reservations ['289cb773-d479-4cce-8101-347a1a4b5f3a', '11bfaa42-31ff-4689-b185-2085c98a7a56', 'f446c9d7-46b4-4d24-ad1a-0b5f6dd446c1', '17da1c87-d765-4585-8830-ab0b981088e5'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:26:56 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-643d810f-7089-4b2a-8c0a-7fa6b789c580 tempest-GroupSnapshotsTest-627094444 None] group_snapshot afe34113-b394-4cda-b348-d603b5542be3: deleted successfully
Sep 18 22:26:58 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:58 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "cinder-quobyte-241f341a-f4e7-4921-95a6-4aa83af6b097" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:26:58 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-241f341a-f4e7-4921-95a6-4aa83af6b097" acquired by "delete_volume" :: waited 0.038s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:26:58 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[303e42f9-9833-421d-ac8b-52fe7e6ca988]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:26:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:26:59 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-a892b153-337a-4f3b-bff8-7ecab01edd89 req-bdd7b5db-421c-4eae-b440-0db0284abda6 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:59 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-a892b153-337a-4f3b-bff8-7ecab01edd89 req-bdd7b5db-421c-4eae-b440-0db0284abda6 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:26:59 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-a892b153-337a-4f3b-bff8-7ecab01edd89 req-bdd7b5db-421c-4eae-b440-0db0284abda6 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Terminate volume connection completed successfully.
Sep 18 22:26:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-a892b153-337a-4f3b-bff8-7ecab01edd89 req-bdd7b5db-421c-4eae-b440-0db0284abda6 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Deleting attachment 3b6ddca9-63ed-4dc9-8f9d-cb99d76f937b. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:26:59 devstack quobyte-client[83360]: System call of process 97258 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:26:59 devstack quobyte-client[83360]: System call of process 97258 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097" returned: 0 in 1.625s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-241f341a-f4e7-4921-95a6-4aa83af6b097" returned: 0 in 0.566s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Lock "cinder-quobyte-241f341a-f4e7-4921-95a6-4aa83af6b097" released by "delete_volume" :: held 2.544s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:01 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Created reservations ['484ae7c6-c1c8-4400-b134-ce737b89a8c9'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:27:01 devstack cinder-volume[83342]: WARNING cinder.quota [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1824111246 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1824111246, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:27:01 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Created reservations ['f75a6ca5-0d69-4117-a8fa-c27bdc418531', '9899181f-6589-4754-a210-38f0bc9f0565', '6ee20a91-1e49-430c-a3f8-2b66bbfb404d', 'd44af168-e89d-4c1a-b7f2-3e6101c623d4'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:27:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.683s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:03 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:27:03 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-135b0047-9041-4ee5-88aa-4b42742a3895 tempest-GroupSnapshotsTest-627094444 None] Delete group completed successfully.
Sep 18 22:27:07 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-5dc67861-d81a-476b-8070-5b4eec71f4ec tempest-TestShelveInstance-1009296260 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:07 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-5dc67861-d81a-476b-8070-5b4eec71f4ec tempest-TestShelveInstance-1009296260 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:07 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-5dc67861-d81a-476b-8070-5b4eec71f4ec tempest-TestShelveInstance-1009296260 None] Terminate volume connection completed successfully.
Sep 18 22:27:07 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-5dc67861-d81a-476b-8070-5b4eec71f4ec tempest-TestShelveInstance-1009296260 None] Deleting attachment 98d7b609-e902-4cc3-90e9-635bc5fd6b23. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:27:07 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Acquiring lock "cinder-98b5711e-5028-4b98-93be-e10b1b0549ae-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:07 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Lock "cinder-98b5711e-5028-4b98-93be-e10b1b0549ae-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:08 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Acquiring lock "cinder-quobyte-98b5711e-5028-4b98-93be-e10b1b0549ae" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Lock "cinder-quobyte-98b5711e-5028-4b98-93be-e10b1b0549ae" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:08 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a1fa97-6299-4f43-8fc8-1ce081b7a2ee]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:27:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae" returned: 0 in 0.610s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae" returned: 1 in 0.433s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:27:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-98b5711e-5028-4b98-93be-e10b1b0549ae" returned: 0 in 0.112s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Lock "cinder-quobyte-98b5711e-5028-4b98-93be-e10b1b0549ae" released by "delete_volume" :: held 1.444s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:09 devstack cinder-volume[83342]: DEBUG cinder.quota [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Created reservations ['f63979cb-60f6-4564-8f6e-a939692d0407', 'a612fba3-741c-4f8d-bb96-e78aec270bb8', 'a2aaa2f7-a74f-4d87-aa44-4ccbbba100b3', '47a95d8e-01d8-41c1-b835-f7ff4d306249'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:27:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.165s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:10 devstack cinder-volume[83342]: DEBUG cinder.manager [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:27:10 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Deleted volume successfully.
Sep 18 22:27:10 devstack cinder-volume[83342]: DEBUG cinder.coordination [req-9d7e1a43-5e4f-4b17-85f4-13b119c8fed1 req-87945784-9517-4869-b201-4af6f2888b64 tempest-TestShelveInstance-1009296260 None] Lock "cinder-98b5711e-5028-4b98-93be-e10b1b0549ae-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Acquiring lock "cinder-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "cinder-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:14 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=98,cinder:SELECT=116,cinder:INSERT=27,cinder:DELETE=3 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:27:14 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=103,cinder:SELECT=90,cinder:INSERT=17,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:27:14 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Acquiring lock "cinder-quobyte-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "cinder-quobyte-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d" acquired by "delete_volume" :: waited 0.015s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:14 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09d8345-160b-4519-973b-feff9d36bf02]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:27:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:14 devstack quobyte-client[83360]: System call of process 97355 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d" returned: 0 in 0.575s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d" returned: 0 in 0.149s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "cinder-quobyte-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d" released by "delete_volume" :: held 1.209s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:16 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Created reservations ['ce6a98d9-7022-419b-9443-96fcc8d305ea', 'e6b8702f-38c0-46aa-8c3c-ce67818b373e', '7ea73918-781d-47ee-b3d0-cff9531dc281', '26697f6c-a1fb-4b03-afd7-811855b27e58'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:27:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.123s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:16 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:27:16 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Deleted volume successfully.
Sep 18 22:27:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Acquiring lock "cinder-d4552dde-187d-49d3-a03b-b6716782861f-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bfe31e4e-cb7f-4d82-b6b6-4dc9d6b692c7 tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "cinder-ab66f2c3-5016-496c-a87d-a1f0bfbceb6d-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "cinder-d4552dde-187d-49d3-a03b-b6716782861f-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:17 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Acquiring lock "cinder-quobyte-d4552dde-187d-49d3-a03b-b6716782861f" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "cinder-quobyte-d4552dde-187d-49d3-a03b-b6716782861f" acquired by "delete_volume" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:17 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb1b48c-b40e-46c6-98fd-3df59a16eacf]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:27:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d4552dde-187d-49d3-a03b-b6716782861f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:17 devstack quobyte-client[83360]: System call of process 97361 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:17 devstack quobyte-client[83360]: System call of process 97361 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d4552dde-187d-49d3-a03b-b6716782861f" returned: 0 in 0.598s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d4552dde-187d-49d3-a03b-b6716782861f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d4552dde-187d-49d3-a03b-b6716782861f" returned: 0 in 0.149s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:18 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "cinder-quobyte-d4552dde-187d-49d3-a03b-b6716782861f" released by "delete_volume" :: held 0.979s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:18 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Created reservations ['8f819e22-0f0b-4f83-ba0f-8efc7d835618', '07d21722-e352-4140-818d-2cb71615bcac', 'fb55da70-1a57-4ffd-bdc2-c6fdd096f81a', '48ba013a-3c0f-436c-9417-d48af6b6658f'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:27:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.143s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:18 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:27:19 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Deleted volume successfully.
Sep 18 22:27:19 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1e48573c-c967-4f60-a785-3785519c1e9a tempest-TestServerVolumeAttachmentScenario-1041188321 None] Lock "cinder-d4552dde-187d-49d3-a03b-b6716782861f-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:28 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-f22fab18-76e0-423c-87b5-875691105d39 tempest-GroupsTest-683362368 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:28 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-f22fab18-76e0-423c-87b5-875691105d39 tempest-GroupsTest-683362368 None] Group tempest-Group1-516178608: creating
Sep 18 22:27:28 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-f22fab18-76e0-423c-87b5-875691105d39 tempest-GroupsTest-683362368 None] Group tempest-Group1-516178608: created successfully
Sep 18 22:27:28 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-f22fab18-76e0-423c-87b5-875691105d39 tempest-GroupsTest-683362368 None] Create group completed successfully.
Sep 18 22:27:30 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-caf0442b-9f36-4607-b35f-c1c19737792d tempest-GroupsTest-683362368 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:30 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-caf0442b-9f36-4607-b35f-c1c19737792d tempest-GroupsTest-683362368 None] Group tempest-Group2-1896271329: creating
Sep 18 22:27:30 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-caf0442b-9f36-4607-b35f-c1c19737792d tempest-GroupsTest-683362368 None] Group tempest-Group2-1896271329: created successfully
Sep 18 22:27:30 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-caf0442b-9f36-4607-b35f-c1c19737792d tempest-GroupsTest-683362368 None] Create group completed successfully.
Sep 18 22:27:31 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Flow 'volume_create_manager' (a1c778b0-7265-4486-beaa-3350840d63aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811b4cb7-6b77-4a78-8c53-1cccf2df13a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811b4cb7-6b77-4a78-8c53-1cccf2df13a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1638138308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=92eb02f1-8966-4faa-b452-39e62cd974b7,host='devstack@QuobyteHD#QuobyteHD',id=3be938dd-f135-409a-a02d-cc047ea2fa4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f978885e3dd64008b2702f896bbf2314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:32Z,use_quota=True,user_id='5492a04722704799a107be37c5a54143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9218e493-e4e0-437a-a3d8-91d905a1ce80),volume_type_id=9218e493-e4e0-437a-a3d8-91d905a1ce80)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19484dd5-2abd-4a69-b16d-bcbc2af56b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19484dd5-2abd-4a69-b16d-bcbc2af56b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a63b1f-feb3-479b-b794-aa126ec3d953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a63b1f-feb3-479b-b794-aa126ec3d953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3be938dd-f135-409a-a02d-cc047ea2fa4c', 'volume_name': 'volume-3be938dd-f135-409a-a02d-cc047ea2fa4c', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51545cbe-d182-498c-bf0a-0ddf3a109b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51545cbe-d182-498c-bf0a-0ddf3a109b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e13a90-c39d-41ad-83f6-e64a824fc373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:31 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Volume 3be938dd-f135-409a-a02d-cc047ea2fa4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3be938dd-f135-409a-a02d-cc047ea2fa4c', 'volume_size': 1}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=92eb02f1-8966-4faa-b452-39e62cd974b7,created_at=2025-09-18T20:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1638138308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=92eb02f1-8966-4faa-b452-39e62cd974b7,host='devstack@QuobyteHD#QuobyteHD',id=3be938dd-f135-409a-a02d-cc047ea2fa4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f978885e3dd64008b2702f896bbf2314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:32Z,use_quota=True,user_id='5492a04722704799a107be37c5a54143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9218e493-e4e0-437a-a3d8-91d905a1ce80),volume_type_id=9218e493-e4e0-437a-a3d8-91d905a1ce80)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Creating volume 3be938dd-f135-409a-a02d-cc047ea2fa4c {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:27:31 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:27:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3be938dd-f135-409a-a02d-cc047ea2fa4c 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:32 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=100, name=volume-3be938dd-f135-409a-a02d-cc047ea2fa4c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:27:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3be938dd-f135-409a-a02d-cc047ea2fa4c 1073741824" returned: 0 in 0.492s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3be938dd-f135-409a-a02d-cc047ea2fa4c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3be938dd-f135-409a-a02d-cc047ea2fa4c" returned: 0 in 0.216s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:32 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] <== create_volume: return (928ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:27:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:33 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e13a90-c39d-41ad-83f6-e64a824fc373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be938dd-f135-409a-a02d-cc047ea2fa4c', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:33 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6a334f-5f9e-484e-a3e5-fca22ba4763f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:33 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Volume volume-3be938dd-f135-409a-a02d-cc047ea2fa4c (3be938dd-f135-409a-a02d-cc047ea2fa4c): created successfully
Sep 18 22:27:33 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6a334f-5f9e-484e-a3e5-fca22ba4763f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:33 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Flow 'volume_create_manager' (a1c778b0-7265-4486-beaa-3350840d63aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:33 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-6da3b3e2-956e-40d0-9b4b-5d8c80f026fc tempest-GroupsTest-683362368 None] Created volume successfully.
Sep 18 22:27:34 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Acquiring lock "cinder-quobyte-3be938dd-f135-409a-a02d-cc047ea2fa4c" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Lock "cinder-quobyte-3be938dd-f135-409a-a02d-cc047ea2fa4c" acquired by "delete_volume" :: waited 0.018s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:34 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[67db5340-2a2a-4379-b631-6fb710415f3b]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:27:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3be938dd-f135-409a-a02d-cc047ea2fa4c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:35 devstack quobyte-client[83360]: System call of process 97416 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:35 devstack quobyte-client[83360]: System call of process 97416 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3be938dd-f135-409a-a02d-cc047ea2fa4c" returned: 0 in 0.633s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3be938dd-f135-409a-a02d-cc047ea2fa4c {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3be938dd-f135-409a-a02d-cc047ea2fa4c" returned: 0 in 0.169s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:35 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Lock "cinder-quobyte-3be938dd-f135-409a-a02d-cc047ea2fa4c" released by "delete_volume" :: held 1.057s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:36 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Created reservations ['f3227563-79d6-47c2-b156-073fef4f8b09'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:27:36 devstack cinder-volume[83342]: WARNING cinder.quota [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1793329264 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1793329264, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:27:36 devstack cinder-volume[83342]: WARNING cinder.quota [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1793329264 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1793329264, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:27:36 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Created reservations ['e19713a8-11ac-4b51-a5da-64f5be165406', '60ca419d-28b1-4ecd-9a48-2a09e66ebdd9', '67b5ad60-0aae-43fe-9f7c-8e0d580be564', '98b6394c-7127-4cab-9737-7b61491f3469'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:27:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.120s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:36 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:27:36 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-02750186-bf39-4f0f-b5f1-10bb59b49650 tempest-GroupsTest-683362368 None] Delete group completed successfully.
Sep 18 22:27:37 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-1045f596-1643-4e8e-9a9d-b494b852dee8 tempest-GroupsTest-683362368 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:37 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-1045f596-1643-4e8e-9a9d-b494b852dee8 tempest-GroupsTest-683362368 None] Created reservations ['f3f13697-6da9-42bc-87d4-f72bd838fba0'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:27:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1045f596-1643-4e8e-9a9d-b494b852dee8 tempest-GroupsTest-683362368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1045f596-1643-4e8e-9a9d-b494b852dee8 tempest-GroupsTest-683362368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1045f596-1643-4e8e-9a9d-b494b852dee8 tempest-GroupsTest-683362368 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1045f596-1643-4e8e-9a9d-b494b852dee8 tempest-GroupsTest-683362368 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1045f596-1643-4e8e-9a9d-b494b852dee8 tempest-GroupsTest-683362368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1045f596-1643-4e8e-9a9d-b494b852dee8 tempest-GroupsTest-683362368 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1045f596-1643-4e8e-9a9d-b494b852dee8 tempest-GroupsTest-683362368 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.099s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:37 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-1045f596-1643-4e8e-9a9d-b494b852dee8 tempest-GroupsTest-683362368 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:27:37 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-1045f596-1643-4e8e-9a9d-b494b852dee8 tempest-GroupsTest-683362368 None] Delete group completed successfully.
Sep 18 22:27:39 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e6c6602e-4ca6-4d3a-ac10-21599d0d9679 tempest-GroupsTest-683362368 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:39 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e6c6602e-4ca6-4d3a-ac10-21599d0d9679 tempest-GroupsTest-683362368 None] Group tempest-GroupsTest-Group-1304724637: creating
Sep 18 22:27:39 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e6c6602e-4ca6-4d3a-ac10-21599d0d9679 tempest-GroupsTest-683362368 None] Group tempest-GroupsTest-Group-1304724637: created successfully
Sep 18 22:27:39 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e6c6602e-4ca6-4d3a-ac10-21599d0d9679 tempest-GroupsTest-683362368 None] Create group completed successfully.
Sep 18 22:27:40 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Flow 'volume_create_manager' (a29ddc8d-f9ee-4df2-825b-1b8467f94e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b37ea3f-708c-4c48-8607-592bb7505920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b37ea3f-708c-4c48-8607-592bb7505920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-113443207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c2a8dc0a-d264-4394-8f89-809b7c695d48,host='devstack@QuobyteHD#QuobyteHD',id=bb0f8018-9017-4234-b4fc-a0a83f0ddf0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f978885e3dd64008b2702f896bbf2314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:40Z,use_quota=True,user_id='5492a04722704799a107be37c5a54143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d56fa7f-bac9-4c76-a85b-cea9dc62f5ac),volume_type_id=9d56fa7f-bac9-4c76-a85b-cea9dc62f5ac)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950b67a6-3b6f-401d-bca3-9220443adda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950b67a6-3b6f-401d-bca3-9220443adda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052be922-a215-4330-8f93-12de87c17218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052be922-a215-4330-8f93-12de87c17218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb0f8018-9017-4234-b4fc-a0a83f0ddf0d', 'volume_name': 'volume-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e06d4d-d125-4e21-b76b-1100170a5426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5e06d4d-d125-4e21-b76b-1100170a5426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b762763-b97b-408e-b436-73835e68325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:40 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Volume bb0f8018-9017-4234-b4fc-a0a83f0ddf0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d', 'volume_size': 1}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c2a8dc0a-d264-4394-8f89-809b7c695d48,created_at=2025-09-18T20:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-113443207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c2a8dc0a-d264-4394-8f89-809b7c695d48,host='devstack@QuobyteHD#QuobyteHD',id=bb0f8018-9017-4234-b4fc-a0a83f0ddf0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f978885e3dd64008b2702f896bbf2314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:40Z,use_quota=True,user_id='5492a04722704799a107be37c5a54143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d56fa7f-bac9-4c76-a85b-cea9dc62f5ac),volume_type_id=9d56fa7f-bac9-4c76-a85b-cea9dc62f5ac)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Creating volume bb0f8018-9017-4234-b4fc-a0a83f0ddf0d {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:27:40 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:40 devstack quobyte-client[83360]: System call of process 97423 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:40 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=101, name=volume-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d 1073741824" returned: 0 in 0.410s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:41 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Flow 'volume_create_manager' (eacda05c-13fb-4393-b8e7-51b8002dedba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da27998-955c-4726-b17a-c0a51af38bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da27998-955c-4726-b17a-c0a51af38bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1487826333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc63bbd6-49e1-4d3a-90cc-08691839f041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d31e69f1f4444a41e96fcc8f9e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:41Z,use_quota=True,user_id='c4aab510c9b54db0b8923f6646682fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3c1955-eebd-4758-910e-49a39c7779ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a3c1955-eebd-4758-910e-49a39c7779ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39cf9ba-f54e-46fc-b0a1-74aaa757f1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39cf9ba-f54e-46fc-b0a1-74aaa757f1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc63bbd6-49e1-4d3a-90cc-08691839f041', 'volume_name': 'volume-cc63bbd6-49e1-4d3a-90cc-08691839f041', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2cf961-7f2b-4ffd-912a-186de483e87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2cf961-7f2b-4ffd-912a-186de483e87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6591fb7-672d-442b-9ace-d8ac7a30fb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:41 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume cc63bbd6-49e1-4d3a-90cc-08691839f041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc63bbd6-49e1-4d3a-90cc-08691839f041', 'volume_size': 1}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d" returned: 0 in 0.464s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] <== create_volume: return (916ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.034s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1487826333',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc63bbd6-49e1-4d3a-90cc-08691839f041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d31e69f1f4444a41e96fcc8f9e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:41Z,use_quota=True,user_id='c4aab510c9b54db0b8923f6646682fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Creating volume cc63bbd6-49e1-4d3a-90cc-08691839f041 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:27:41 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-cc63bbd6-49e1-4d3a-90cc-08691839f041 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:41 devstack quobyte-client[83360]: System call of process 97428 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:41 devstack quobyte-client[83360]: System call of process 97428 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:41 devstack quobyte-client[83360]: System call of process 97428 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:41 devstack quobyte-client[83360]: System call of process 97428 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:41 devstack quobyte-client[83360]: System call of process 97428 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:41 devstack quobyte-client[83360]: System call of process 97428 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:41 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=102, name=volume-cc63bbd6-49e1-4d3a-90cc-08691839f041, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b762763-b97b-408e-b436-73835e68325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759c0d6e-31cd-4a74-9084-9029d2eadc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:41 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Volume volume-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d (bb0f8018-9017-4234-b4fc-a0a83f0ddf0d): created successfully
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (759c0d6e-31cd-4a74-9084-9029d2eadc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Flow 'volume_create_manager' (a29ddc8d-f9ee-4df2-825b-1b8467f94e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-cc63bbd6-49e1-4d3a-90cc-08691839f041 1073741824" returned: 0 in 0.441s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-cc63bbd6-49e1-4d3a-90cc-08691839f041 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-cc63bbd6-49e1-4d3a-90cc-08691839f041" returned: 0 in 0.150s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:42 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] <== create_volume: return (647ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:27:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:42 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-1f63f2dd-ed54-4d62-a8dd-164baa447259 tempest-GroupsTest-683362368 None] Created volume successfully.
Sep 18 22:27:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6591fb7-672d-442b-9ace-d8ac7a30fb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc63bbd6-49e1-4d3a-90cc-08691839f041', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eafc945-a503-4863-91fb-1c872d9e8b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:42 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume volume-cc63bbd6-49e1-4d3a-90cc-08691839f041 (cc63bbd6-49e1-4d3a-90cc-08691839f041): created successfully
Sep 18 22:27:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eafc945-a503-4863-91fb-1c872d9e8b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Flow 'volume_create_manager' (eacda05c-13fb-4393-b8e7-51b8002dedba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:42 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-b97c195d-50fc-4657-bc9d-293ea6f09be5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Created volume successfully.
Sep 18 22:27:43 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Flow 'volume_create_manager' (d0d7e467-ba7f-43c8-b22f-cd767933412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c3066f-1e6b-49b5-95bc-9001b49a643e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c3066f-1e6b-49b5-95bc-9001b49a643e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1226805011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c2a8dc0a-d264-4394-8f89-809b7c695d48,host='devstack@QuobyteHD#QuobyteHD',id=df2a87f6-1290-4fbf-8440-8bc4e7e34044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f978885e3dd64008b2702f896bbf2314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:43Z,use_quota=True,user_id='5492a04722704799a107be37c5a54143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d56fa7f-bac9-4c76-a85b-cea9dc62f5ac),volume_type_id=9d56fa7f-bac9-4c76-a85b-cea9dc62f5ac)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cccd58-e1a4-49b4-8eb7-9e84e07d8978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cccd58-e1a4-49b4-8eb7-9e84e07d8978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533ad68a-54c0-4b99-9516-7b2d12a5edbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533ad68a-54c0-4b99-9516-7b2d12a5edbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df2a87f6-1290-4fbf-8440-8bc4e7e34044', 'volume_name': 'volume-df2a87f6-1290-4fbf-8440-8bc4e7e34044', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc574bf-d26f-40d9-bc36-01af59a1fd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc574bf-d26f-40d9-bc36-01af59a1fd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9363ee1b-f15b-45e4-a5ec-5dfd081ea44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:43 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Volume df2a87f6-1290-4fbf-8440-8bc4e7e34044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df2a87f6-1290-4fbf-8440-8bc4e7e34044', 'volume_size': 1}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c2a8dc0a-d264-4394-8f89-809b7c695d48,created_at=2025-09-18T20:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1226805011',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c2a8dc0a-d264-4394-8f89-809b7c695d48,host='devstack@QuobyteHD#QuobyteHD',id=df2a87f6-1290-4fbf-8440-8bc4e7e34044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f978885e3dd64008b2702f896bbf2314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:43Z,use_quota=True,user_id='5492a04722704799a107be37c5a54143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d56fa7f-bac9-4c76-a85b-cea9dc62f5ac),volume_type_id=9d56fa7f-bac9-4c76-a85b-cea9dc62f5ac)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Creating volume df2a87f6-1290-4fbf-8440-8bc4e7e34044 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:27:43 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-df2a87f6-1290-4fbf-8440-8bc4e7e34044 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:43 devstack quobyte-client[83360]: System call of process 97432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:43 devstack quobyte-client[83360]: System call of process 97432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:43 devstack quobyte-client[83360]: System call of process 97432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:43 devstack quobyte-client[83360]: System call of process 97432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:43 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=103, name=volume-df2a87f6-1290-4fbf-8440-8bc4e7e34044, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:27:43 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Flow 'volume_create_manager' (11fe4d6e-c0d8-4188-9b34-8efe2a589496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f878ee-bfbf-4b49-9831-585a2aad1f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f878ee-bfbf-4b49-9831-585a2aad1f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-959559429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68288924-e8cb-42f4-8dfd-d8c54efd7bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d31e69f1f4444a41e96fcc8f9e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:43Z,use_quota=True,user_id='c4aab510c9b54db0b8923f6646682fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c99057-3493-4e02-a3d4-fd3fe755e132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c99057-3493-4e02-a3d4-fd3fe755e132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d918fb93-5b6b-4741-b36d-b50ec4cf491e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d918fb93-5b6b-4741-b36d-b50ec4cf491e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68288924-e8cb-42f4-8dfd-d8c54efd7bb6', 'volume_name': 'volume-68288924-e8cb-42f4-8dfd-d8c54efd7bb6', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0bd1b7-c8cb-455d-a657-d480f515462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0bd1b7-c8cb-455d-a657-d480f515462b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e72ed97-1043-4b03-bd30-e44c38474ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:43 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume 68288924-e8cb-42f4-8dfd-d8c54efd7bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68288924-e8cb-42f4-8dfd-d8c54efd7bb6', 'volume_size': 1}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-df2a87f6-1290-4fbf-8440-8bc4e7e34044 1073741824" returned: 0 in 0.746s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-df2a87f6-1290-4fbf-8440-8bc4e7e34044 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:44 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Flow 'volume_create_manager' (c8eac037-54d7-43ea-abe5-f542e6505952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d805b15b-d35d-4ead-86bb-94277a77086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-df2a87f6-1290-4fbf-8440-8bc4e7e34044" returned: 0 in 0.573s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d805b15b-d35d-4ead-86bb-94277a77086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1567119917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ad23ee-22e6-42f7-9f59-522642779ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d31e69f1f4444a41e96fcc8f9e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:44Z,use_quota=True,user_id='c4aab510c9b54db0b8923f6646682fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b541517f-070c-490f-9a0b-bde2389890ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b541517f-070c-490f-9a0b-bde2389890ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d04e6f-f004-4c1c-ae14-21933886fa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d04e6f-f004-4c1c-ae14-21933886fa0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29ad23ee-22e6-42f7-9f59-522642779ed2', 'volume_name': 'volume-29ad23ee-22e6-42f7-9f59-522642779ed2', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0d9c47-d605-449f-9f1a-db70c54cc5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0d9c47-d605-449f-9f1a-db70c54cc5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edb7c1f-166c-4e3f-bc10-544fc77fa8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:44 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume 29ad23ee-22e6-42f7-9f59-522642779ed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29ad23ee-22e6-42f7-9f59-522642779ed2', 'volume_size': 1}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] <== create_volume: return (1415ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.695s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-959559429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68288924-e8cb-42f4-8dfd-d8c54efd7bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d31e69f1f4444a41e96fcc8f9e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:43Z,use_quota=True,user_id='c4aab510c9b54db0b8923f6646682fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Creating volume 68288924-e8cb-42f4-8dfd-d8c54efd7bb6 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:27:44 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:27:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-68288924-e8cb-42f4-8dfd-d8c54efd7bb6 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:44 devstack quobyte-client[83360]: System call of process 97436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:44 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=104, name=volume-68288924-e8cb-42f4-8dfd-d8c54efd7bb6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:27:45 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Flow 'volume_create_manager' (20079ef9-a74b-4d78-b60e-d2f317ff1791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd03a721-0c17-4822-a39c-93ace9bf9e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9363ee1b-f15b-45e4-a5ec-5dfd081ea44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df2a87f6-1290-4fbf-8440-8bc4e7e34044', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c963ffc-8791-4462-b816-372cef886b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:45 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Flow 'volume_create_manager' (f5428171-5553-40ab-a3c8-e1753e639831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40257fa-59e9-4913-9f6e-81eb84927ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:45 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Volume volume-df2a87f6-1290-4fbf-8440-8bc4e7e34044 (df2a87f6-1290-4fbf-8440-8bc4e7e34044): created successfully
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c963ffc-8791-4462-b816-372cef886b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Flow 'volume_create_manager' (d0d7e467-ba7f-43c8-b22f-cd767933412b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd03a721-0c17-4822-a39c-93ace9bf9e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1626742483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc69a69-9d4d-45a2-a07c-71a49be914fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d31e69f1f4444a41e96fcc8f9e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:45Z,use_quota=True,user_id='c4aab510c9b54db0b8923f6646682fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0583ee-d155-49bf-8172-ed6ebb4b5f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0583ee-d155-49bf-8172-ed6ebb4b5f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fb224d-3c65-4a63-95a7-bf0f7eb39cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5fb224d-3c65-4a63-95a7-bf0f7eb39cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efc69a69-9d4d-45a2-a07c-71a49be914fe', 'volume_name': 'volume-efc69a69-9d4d-45a2-a07c-71a49be914fe', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d704f7-96d0-47fc-981b-635875568977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d704f7-96d0-47fc-981b-635875568977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e3760b-df54-4ec2-a715-f83de6654153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:45 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume efc69a69-9d4d-45a2-a07c-71a49be914fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efc69a69-9d4d-45a2-a07c-71a49be914fe', 'volume_size': 1}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-68288924-e8cb-42f4-8dfd-d8c54efd7bb6 1073741824" returned: 0 in 0.803s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-68288924-e8cb-42f4-8dfd-d8c54efd7bb6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:45 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-cd879f28-1d13-408d-8b42-08511f796278 tempest-GroupsTest-683362368 None] Created volume successfully.
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b40257fa-59e9-4913-9f6e-81eb84927ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1816338713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aeeb693-8519-4ed1-81b2-338587a5fa09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d31e69f1f4444a41e96fcc8f9e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:44Z,use_quota=True,user_id='c4aab510c9b54db0b8923f6646682fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853ec49f-2e8f-47ab-bbd2-c30f1dab19d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (853ec49f-2e8f-47ab-bbd2-c30f1dab19d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7dd6a9-8e7e-427c-9f5e-2ac3da282be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7dd6a9-8e7e-427c-9f5e-2ac3da282be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aeeb693-8519-4ed1-81b2-338587a5fa09', 'volume_name': 'volume-5aeeb693-8519-4ed1-81b2-338587a5fa09', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470e1dca-27bf-4f85-a4db-b6f26c92e619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (470e1dca-27bf-4f85-a4db-b6f26c92e619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dadf043a-66e0-4d75-be12-837a316b1b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:45 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume 5aeeb693-8519-4ed1-81b2-338587a5fa09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aeeb693-8519-4ed1-81b2-338587a5fa09', 'volume_size': 1}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-68288924-e8cb-42f4-8dfd-d8c54efd7bb6" returned: 0 in 0.401s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] <== create_volume: return (1237ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.315s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1567119917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29ad23ee-22e6-42f7-9f59-522642779ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d31e69f1f4444a41e96fcc8f9e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:44Z,use_quota=True,user_id='c4aab510c9b54db0b8923f6646682fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Creating volume 29ad23ee-22e6-42f7-9f59-522642779ed2 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:27:45 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:27:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-29ad23ee-22e6-42f7-9f59-522642779ed2 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:46 devstack quobyte-client[83360]: System call of process 97440 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:46 devstack quobyte-client[83360]: System call of process 97440 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:46 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=105, name=volume-29ad23ee-22e6-42f7-9f59-522642779ed2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:27:46 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Flow 'volume_create_manager' (cb417bf8-2258-4e85-984b-6f6e76f3b2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87753a10-5641-4980-bf22-cc366b5458a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87753a10-5641-4980-bf22-cc366b5458a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1833820930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8522127-ffd2-4f88-8d51-db3337a0742b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d31e69f1f4444a41e96fcc8f9e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:45Z,use_quota=True,user_id='c4aab510c9b54db0b8923f6646682fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adc8fc7-e544-480e-a150-72ba60eb9273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7adc8fc7-e544-480e-a150-72ba60eb9273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab08bc5-ad3c-4d89-b079-fd826320ff84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab08bc5-ad3c-4d89-b079-fd826320ff84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8522127-ffd2-4f88-8d51-db3337a0742b', 'volume_name': 'volume-d8522127-ffd2-4f88-8d51-db3337a0742b', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40cbb24-93e8-439e-bd4b-e6d2c462e296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40cbb24-93e8-439e-bd4b-e6d2c462e296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d56804-4c74-4f0e-b3a6-6ea3637eb0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:46 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume d8522127-ffd2-4f88-8d51-db3337a0742b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8522127-ffd2-4f88-8d51-db3337a0742b', 'volume_size': 1}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e72ed97-1043-4b03-bd30-e44c38474ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68288924-e8cb-42f4-8dfd-d8c54efd7bb6', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ba679d-49f9-4f2f-8a6d-0bbc484eaf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-29ad23ee-22e6-42f7-9f59-522642779ed2 1073741824" returned: 0 in 0.670s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-29ad23ee-22e6-42f7-9f59-522642779ed2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:46 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume volume-68288924-e8cb-42f4-8dfd-d8c54efd7bb6 (68288924-e8cb-42f4-8dfd-d8c54efd7bb6): created successfully
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ba679d-49f9-4f2f-8a6d-0bbc484eaf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Flow 'volume_create_manager' (11fe4d6e-c0d8-4188-9b34-8efe2a589496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:47 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-3691975b-5bbe-47c2-a93b-49693c6b5012 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Created volume successfully.
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-29ad23ee-22e6-42f7-9f59-522642779ed2" returned: 0 in 0.743s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:47 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-d0a3ed13-b823-4b9c-9d54-4ce3a8f554d7 tempest-GroupsTest-683362368 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] <== create_volume: return (1458ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.938s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1626742483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc69a69-9d4d-45a2-a07c-71a49be914fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d31e69f1f4444a41e96fcc8f9e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:45Z,use_quota=True,user_id='c4aab510c9b54db0b8923f6646682fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Creating volume efc69a69-9d4d-45a2-a07c-71a49be914fe {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:27:47 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-efc69a69-9d4d-45a2-a07c-71a49be914fe 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.513s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:47 devstack quobyte-client[83360]: System call of process 97445 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:47 devstack quobyte-client[83360]: System call of process 97445 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:47 devstack quobyte-client[83360]: System call of process 97445 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:47 devstack quobyte-client[83360]: System call of process 97445 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:47 devstack quobyte-client[83360]: System call of process 97445 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:47 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=106, name=volume-efc69a69-9d4d-45a2-a07c-71a49be914fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2edb7c1f-166c-4e3f-bc10-544fc77fa8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29ad23ee-22e6-42f7-9f59-522642779ed2', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa278e5-6b1d-4eac-8144-8a8001cd1b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-efc69a69-9d4d-45a2-a07c-71a49be914fe 1073741824" returned: 0 in 0.459s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-efc69a69-9d4d-45a2-a07c-71a49be914fe {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:48 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume volume-29ad23ee-22e6-42f7-9f59-522642779ed2 (29ad23ee-22e6-42f7-9f59-522642779ed2): created successfully
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa278e5-6b1d-4eac-8144-8a8001cd1b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Flow 'volume_create_manager' (c8eac037-54d7-43ea-abe5-f542e6505952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-efc69a69-9d4d-45a2-a07c-71a49be914fe" returned: 0 in 0.360s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] <== create_volume: return (841ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.470s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1816338713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aeeb693-8519-4ed1-81b2-338587a5fa09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d31e69f1f4444a41e96fcc8f9e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:44Z,use_quota=True,user_id='c4aab510c9b54db0b8923f6646682fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Creating volume 5aeeb693-8519-4ed1-81b2-338587a5fa09 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:27:48 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5aeeb693-8519-4ed1-81b2-338587a5fa09 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:48 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-afaedfcf-0219-4b49-96eb-25e4a8ea5863 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Created volume successfully.
Sep 18 22:27:48 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=107, name=volume-5aeeb693-8519-4ed1-81b2-338587a5fa09, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e3760b-df54-4ec2-a715-f83de6654153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efc69a69-9d4d-45a2-a07c-71a49be914fe', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed06f1b-a647-4321-b27d-778070d5c3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:48 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-d0a3ed13-b823-4b9c-9d54-4ce3a8f554d7 tempest-GroupsTest-683362368 None] Update group completed successfully.
Sep 18 22:27:48 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume volume-efc69a69-9d4d-45a2-a07c-71a49be914fe (efc69a69-9d4d-45a2-a07c-71a49be914fe): created successfully
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed06f1b-a647-4321-b27d-778070d5c3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Flow 'volume_create_manager' (20079ef9-a74b-4d78-b60e-d2f317ff1791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5aeeb693-8519-4ed1-81b2-338587a5fa09 1073741824" returned: 0 in 0.582s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5aeeb693-8519-4ed1-81b2-338587a5fa09 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:49 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c56c39af-3a8e-465a-b5e4-1d0856abea39 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Created volume successfully.
Sep 18 22:27:49 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-0019ffad-488a-4a12-a77e-9dace723bcfd tempest-GroupsTest-683362368 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5aeeb693-8519-4ed1-81b2-338587a5fa09" returned: 0 in 0.450s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] <== create_volume: return (1069ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.866s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1833820930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8522127-ffd2-4f88-8d51-db3337a0742b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d31e69f1f4444a41e96fcc8f9e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:27:45Z,use_quota=True,user_id='c4aab510c9b54db0b8923f6646682fb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Creating volume d8522127-ffd2-4f88-8d51-db3337a0742b {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:27:49 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d8522127-ffd2-4f88-8d51-db3337a0742b 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:49 devstack quobyte-client[83360]: System call of process 97453 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:49 devstack quobyte-client[83360]: System call of process 97453 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:49 devstack quobyte-client[83360]: System call of process 97453 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:49 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=108, name=volume-d8522127-ffd2-4f88-8d51-db3337a0742b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dadf043a-66e0-4d75-be12-837a316b1b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aeeb693-8519-4ed1-81b2-338587a5fa09', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1808ed4-5853-4586-9981-9b68bd72f345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d8522127-ffd2-4f88-8d51-db3337a0742b 1073741824" returned: 0 in 0.449s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d8522127-ffd2-4f88-8d51-db3337a0742b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:50 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume volume-5aeeb693-8519-4ed1-81b2-338587a5fa09 (5aeeb693-8519-4ed1-81b2-338587a5fa09): created successfully
Sep 18 22:27:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1808ed4-5853-4586-9981-9b68bd72f345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Flow 'volume_create_manager' (f5428171-5553-40ab-a3c8-e1753e639831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:50 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-0019ffad-488a-4a12-a77e-9dace723bcfd tempest-GroupsTest-683362368 None] Update group completed successfully.
Sep 18 22:27:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d8522127-ffd2-4f88-8d51-db3337a0742b" returned: 0 in 0.481s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] <== create_volume: return (957ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:27:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:50 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-0e189a36-b7f4-467a-b2fe-b14bd3e20ac0 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Created volume successfully.
Sep 18 22:27:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d56804-4c74-4f0e-b3a6-6ea3637eb0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8522127-ffd2-4f88-8d51-db3337a0742b', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3584313-b418-45fa-9b54-8cffe792b2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:27:50 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume volume-d8522127-ffd2-4f88-8d51-db3337a0742b (d8522127-ffd2-4f88-8d51-db3337a0742b): created successfully
Sep 18 22:27:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3584313-b418-45fa-9b54-8cffe792b2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:27:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Flow 'volume_create_manager' (cb417bf8-2258-4e85-984b-6f6e76f3b2c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:27:50 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-2d81f483-2afe-423a-adc6-a3fe77a7c68a tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Created volume successfully.
Sep 18 22:27:50 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:50 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Acquiring lock "cinder-quobyte-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:50 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Lock "cinder-quobyte-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d" acquired by "delete_volume" :: waited 0.060s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:50 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5636e7c9-f920-4af4-9029-fcb4b26efd25]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:27:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:51 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "cinder-d8522127-ffd2-4f88-8d51-db3337a0742b-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:51 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-d8522127-ffd2-4f88-8d51-db3337a0742b-delete_volume" acquired by "delete_volume" :: waited 0.156s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d" returned: 0 in 0.643s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:51 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:51 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "cinder-quobyte-d8522127-ffd2-4f88-8d51-db3337a0742b" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d" returned: 0 in 0.391s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:51 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-quobyte-d8522127-ffd2-4f88-8d51-db3337a0742b" acquired by "delete_volume" :: waited 0.069s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:51 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Lock "cinder-quobyte-bb0f8018-9017-4234-b4fc-a0a83f0ddf0d" released by "delete_volume" :: held 1.116s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:51 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Acquiring lock "cinder-quobyte-df2a87f6-1290-4fbf-8440-8bc4e7e34044" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:51 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bb35a0-68d0-4128-b7b2-8880d236eaa0]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:27:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d8522127-ffd2-4f88-8d51-db3337a0742b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Lock "cinder-quobyte-df2a87f6-1290-4fbf-8440-8bc4e7e34044" acquired by "delete_volume" :: waited 0.188s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:52 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d1dfcd-f0bf-47c4-8d31-391bd1cb5d8f]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:27:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-df2a87f6-1290-4fbf-8440-8bc4e7e34044 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:52 devstack quobyte-client[83360]: System call of process 97462 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:52 devstack quobyte-client[83360]: System call of process 97462 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:52 devstack quobyte-client[83360]: System call of process 97462 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d8522127-ffd2-4f88-8d51-db3337a0742b" returned: 0 in 0.568s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d8522127-ffd2-4f88-8d51-db3337a0742b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:52 devstack quobyte-client[83360]: System call of process 97463 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d8522127-ffd2-4f88-8d51-db3337a0742b" returned: 0 in 0.115s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-quobyte-d8522127-ffd2-4f88-8d51-db3337a0742b" released by "delete_volume" :: held 0.868s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-df2a87f6-1290-4fbf-8440-8bc4e7e34044" returned: 0 in 0.756s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-df2a87f6-1290-4fbf-8440-8bc4e7e34044 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-df2a87f6-1290-4fbf-8440-8bc4e7e34044" returned: 0 in 0.220s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:53 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Lock "cinder-quobyte-df2a87f6-1290-4fbf-8440-8bc4e7e34044" released by "delete_volume" :: held 1.184s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:53 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Created reservations ['9db258b5-6d89-4ba4-ab87-972b48c3ce76', 'd4516988-99ee-40d4-9646-6bb6414b6939', '128cdcf8-576a-42bb-91e3-0fabe9120eed', '4af7d532-9763-4e3e-b986-481eb36a908f'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:27:53 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Created reservations ['8b8d13ef-61eb-478f-a3b5-9c121a586cb3'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:27:53 devstack cinder-volume[83342]: WARNING cinder.quota [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1757556872 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1757556872, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:27:53 devstack cinder-volume[83342]: WARNING cinder.quota [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1757556872 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1757556872, it is now deprecated. Please use the default quota class for default quota.
Sep 18 22:27:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:53 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Created reservations ['7d7556de-b932-4cd8-b309-db0aad23347b', 'bdb23b0c-27af-4baa-a953-4f07610d2025', '9d40ac38-de36-426e-831d-3e750e2e2a42', '6c47f123-36fd-48e2-a8b2-e8039b1a3316'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:27:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.308s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:53 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:27:53 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Deleted volume successfully.
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e1ba5e03-1c42-435e-a630-9228ee55e227 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-d8522127-ffd2-4f88-8d51-db3337a0742b-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Created reservations ['9944d4d2-e82d-4c42-99b6-52fd5d0d6ce2', '97f81522-2f26-474d-86d6-dfe07d1d4e45', 'a3ed7acb-149f-4684-83f5-c2cd5c56cd2e', 'b7a0d2e3-11d5-410c-b005-7c02d54f6b17'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "cinder-efc69a69-9d4d-45a2-a07c-71a49be914fe-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.278s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-efc69a69-9d4d-45a2-a07c-71a49be914fe-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:54 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-00bbb95b-da08-4515-bb22-9610ccf875a7 tempest-GroupsTest-683362368 None] Delete group completed successfully.
Sep 18 22:27:54 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "cinder-quobyte-efc69a69-9d4d-45a2-a07c-71a49be914fe" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-quobyte-efc69a69-9d4d-45a2-a07c-71a49be914fe" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acd2a15-eace-4e65-b805-c73eb8adf415]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:27:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-efc69a69-9d4d-45a2-a07c-71a49be914fe {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:55 devstack quobyte-client[83360]: System call of process 97472 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-efc69a69-9d4d-45a2-a07c-71a49be914fe" returned: 0 in 0.503s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-efc69a69-9d4d-45a2-a07c-71a49be914fe {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-efc69a69-9d4d-45a2-a07c-71a49be914fe" returned: 0 in 0.113s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:55 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-quobyte-efc69a69-9d4d-45a2-a07c-71a49be914fe" released by "delete_volume" :: held 0.861s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:56 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Created reservations ['3eb1bc0a-70af-4b6d-b094-cbac124f1e76', '82f905e3-7070-46fd-a178-813e56c46239', '4f714166-8b05-49b2-ac48-6dd5600129c7', '128f2aa7-6cea-4c86-a11c-e3658d4d5515'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:27:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.147s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:56 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:27:56 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Deleted volume successfully.
Sep 18 22:27:56 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "cinder-5aeeb693-8519-4ed1-81b2-338587a5fa09-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-5aeeb693-8519-4ed1-81b2-338587a5fa09-delete_volume" acquired by "delete_volume" :: waited 0.165s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b7dad220-b5b1-4903-bd7a-980ec47be321 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-efc69a69-9d4d-45a2-a07c-71a49be914fe-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:57 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "cinder-quobyte-5aeeb693-8519-4ed1-81b2-338587a5fa09" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-quobyte-5aeeb693-8519-4ed1-81b2-338587a5fa09" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:57 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5ddb6e-6478-4eb9-bcfc-d65425cdf0c9]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:27:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5aeeb693-8519-4ed1-81b2-338587a5fa09 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5aeeb693-8519-4ed1-81b2-338587a5fa09" returned: 0 in 0.559s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5aeeb693-8519-4ed1-81b2-338587a5fa09 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5aeeb693-8519-4ed1-81b2-338587a5fa09" returned: 0 in 0.161s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:58 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-quobyte-5aeeb693-8519-4ed1-81b2-338587a5fa09" released by "delete_volume" :: held 0.929s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:58 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Created reservations ['01b609bf-4209-4f43-8bf8-0cd29d4c565c', '6a7928ec-0e99-4ba3-80e6-783a373c0c64', '3347856f-d8a6-4409-bce6-cf77c9276ff5', '8b0d3049-4162-4dcd-a981-59ba3f4897db'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:27:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:27:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:27:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:27:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:27:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:27:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.095s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:58 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:27:58 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Deleted volume successfully.
Sep 18 22:27:59 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bf7ffe63-c8be-4750-9713-106969bdea46 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-5aeeb693-8519-4ed1-81b2-338587a5fa09-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:27:59 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "cinder-29ad23ee-22e6-42f7-9f59-522642779ed2-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:59 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-29ad23ee-22e6-42f7-9f59-522642779ed2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:59 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:27:59 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "cinder-quobyte-29ad23ee-22e6-42f7-9f59-522642779ed2" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:27:59 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-quobyte-29ad23ee-22e6-42f7-9f59-522642779ed2" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:27:59 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7a88b8-ddf4-4a47-a964-5c907a3ef754]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:27:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-29ad23ee-22e6-42f7-9f59-522642779ed2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:27:59 devstack quobyte-client[83360]: System call of process 97485 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:27:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-29ad23ee-22e6-42f7-9f59-522642779ed2" returned: 0 in 0.457s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:27:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-29ad23ee-22e6-42f7-9f59-522642779ed2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-29ad23ee-22e6-42f7-9f59-522642779ed2" returned: 0 in 0.111s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:00 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-quobyte-29ad23ee-22e6-42f7-9f59-522642779ed2" released by "delete_volume" :: held 0.751s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:28:00 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Created reservations ['39ca92c8-ccb2-442f-be18-88914561bcfc', 'a729cb12-da40-4ab4-a4ab-b50855a375e4', '31844a7f-ac43-44f7-9558-abef26e21d9c', '5755134d-13ed-4131-be19-975c748bdb1c'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:28:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:28:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:28:00 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:28:00 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:28:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:28:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.102s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:00 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:28:00 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Deleted volume successfully.
Sep 18 22:28:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-41c76560-281b-4c61-8974-e8cfaeda5541 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-29ad23ee-22e6-42f7-9f59-522642779ed2-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:28:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "cinder-68288924-e8cb-42f4-8dfd-d8c54efd7bb6-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:28:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-68288924-e8cb-42f4-8dfd-d8c54efd7bb6-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:28:01 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:28:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "cinder-quobyte-68288924-e8cb-42f4-8dfd-d8c54efd7bb6" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:28:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-quobyte-68288924-e8cb-42f4-8dfd-d8c54efd7bb6" acquired by "delete_volume" :: waited 0.010s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:28:01 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efd8e5b-25bd-4e20-a53a-0d1bd6ce8284]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:28:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-68288924-e8cb-42f4-8dfd-d8c54efd7bb6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:02 devstack quobyte-client[83360]: System call of process 97493 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:28:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-68288924-e8cb-42f4-8dfd-d8c54efd7bb6" returned: 0 in 0.463s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-68288924-e8cb-42f4-8dfd-d8c54efd7bb6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-68288924-e8cb-42f4-8dfd-d8c54efd7bb6" returned: 0 in 0.122s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:02 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-quobyte-68288924-e8cb-42f4-8dfd-d8c54efd7bb6" released by "delete_volume" :: held 0.775s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:28:03 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Created reservations ['732dad3e-471c-4874-99ac-6a7d62f78c1f', 'fc52f82c-4ce7-44a1-8fcf-770a88a11415', 'b1606497-8258-4141-b31d-102dac78549c', 'd8134d4f-1acb-4972-88a4-57bf81cadc69'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:28:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:28:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:28:03 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:28:03 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:28:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:28:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.103s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:03 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:28:03 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Deleted volume successfully.
Sep 18 22:28:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7e4a2151-9823-4fba-b5e4-446a845714f5 tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-68288924-e8cb-42f4-8dfd-d8c54efd7bb6-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:28:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "cinder-cc63bbd6-49e1-4d3a-90cc-08691839f041-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:28:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-cc63bbd6-49e1-4d3a-90cc-08691839f041-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:28:04 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:28:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "cinder-quobyte-cc63bbd6-49e1-4d3a-90cc-08691839f041" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:28:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-quobyte-cc63bbd6-49e1-4d3a-90cc-08691839f041" acquired by "delete_volume" :: waited 0.015s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:28:04 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e33f0b-cd5c-43ed-ac7d-a29b611463cf]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:28:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-cc63bbd6-49e1-4d3a-90cc-08691839f041 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:04 devstack quobyte-client[83360]: System call of process 97498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:28:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-cc63bbd6-49e1-4d3a-90cc-08691839f041" returned: 0 in 0.477s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-cc63bbd6-49e1-4d3a-90cc-08691839f041 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-cc63bbd6-49e1-4d3a-90cc-08691839f041" returned: 0 in 0.136s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-quobyte-cc63bbd6-49e1-4d3a-90cc-08691839f041" released by "delete_volume" :: held 0.800s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:28:05 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Created reservations ['74f03bee-19d6-449b-8bfe-b3237d2a78fc', '3cc2c9c9-cf6c-407a-99ed-21b864dd0da2', 'de752a2b-c1ec-4922-86ef-7209d236ca11', '670ec924-877a-4db5-af63-3498ef4ad1c8'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:28:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:28:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:28:05 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:28:05 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:28:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:28:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.103s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:05 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:28:05 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Deleted volume successfully.
Sep 18 22:28:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-6f9f7357-c893-44d9-9ac2-f4dc8f43a0dd tempest-CreateVolumesFromSourceVolumeTest-915967366 None] Lock "cinder-cc63bbd6-49e1-4d3a-90cc-08691839f041-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:28:08 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Flow 'volume_create_manager' (07a38205-48b9-49d2-a0ea-6e2aa8b32bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38840b88-f5df-4707-92f9-9785522295ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38840b88-f5df-4707-92f9-9785522295ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1905128652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262a583c-dac9-4caa-8d00-c529bbcf9be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9cc29683ba4d84abee6e71fdb55512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:28:08Z,use_quota=True,user_id='1960a79e582c47bf8339e88289d3f3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc05c7d6-3611-4930-8b9f-9bbf39d1f66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc05c7d6-3611-4930-8b9f-9bbf39d1f66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f59d991-1251-4fa5-9ec2-111b43419a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f59d991-1251-4fa5-9ec2-111b43419a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '262a583c-dac9-4caa-8d00-c529bbcf9be4', 'volume_name': 'volume-262a583c-dac9-4caa-8d00-c529bbcf9be4', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c940c4-8d72-432f-aba6-a7d6348daf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c940c4-8d72-432f-aba6-a7d6348daf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd2e41e-227a-484c-a4e3-879c1eed7214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:08 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Volume 262a583c-dac9-4caa-8d00-c529bbcf9be4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-262a583c-dac9-4caa-8d00-c529bbcf9be4', 'volume_size': 1}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1905128652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=262a583c-dac9-4caa-8d00-c529bbcf9be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d9cc29683ba4d84abee6e71fdb55512',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:28:08Z,use_quota=True,user_id='1960a79e582c47bf8339e88289d3f3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Creating volume 262a583c-dac9-4caa-8d00-c529bbcf9be4 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:28:08 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:28:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-262a583c-dac9-4caa-8d00-c529bbcf9be4 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:09 devstack quobyte-client[83360]: System call of process 97503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:28:09 devstack quobyte-client[83360]: System call of process 97503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:28:09 devstack quobyte-client[83360]: System call of process 97503 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:28:09 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=109, name=volume-262a583c-dac9-4caa-8d00-c529bbcf9be4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:28:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-262a583c-dac9-4caa-8d00-c529bbcf9be4 1073741824" returned: 0 in 0.382s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-262a583c-dac9-4caa-8d00-c529bbcf9be4 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-262a583c-dac9-4caa-8d00-c529bbcf9be4" returned: 0 in 0.098s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] <== create_volume: return (572ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:28:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.587s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:28:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd2e41e-227a-484c-a4e3-879c1eed7214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-262a583c-dac9-4caa-8d00-c529bbcf9be4', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9245b46a-817c-4004-90e2-0a87f922f054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:09 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Volume volume-262a583c-dac9-4caa-8d00-c529bbcf9be4 (262a583c-dac9-4caa-8d00-c529bbcf9be4): created successfully
Sep 18 22:28:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9245b46a-817c-4004-90e2-0a87f922f054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Flow 'volume_create_manager' (07a38205-48b9-49d2-a0ea-6e2aa8b32bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:28:09 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c3a791ef-f3d7-4025-8030-6efe4ebdb947 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Created volume successfully.
Sep 18 22:28:11 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:28:11 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:28:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Flow 'volume_create_manager' (27d05dcd-e382-4390-baa9-5f4dc15fd6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:28:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08a2b0b-fb40-4a3f-8321-7c92a801057d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08a2b0b-fb40-4a3f-8321-7c92a801057d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a375337-534d-44cd-99ca-99e573353e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76061403d6945228f8eb6d0f8e915e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:28:11Z,use_quota=True,user_id='d51a8ec6c5d04f13a404f43f3507b38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fb3278-dd27-4cda-97e3-8a7b7d303aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fb3278-dd27-4cda-97e3-8a7b7d303aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b916bac-c2b3-44c6-9814-a5351be838db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b916bac-c2b3-44c6-9814-a5351be838db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0a375337-534d-44cd-99ca-99e573353e9f', 'volume_name': 'volume-0a375337-534d-44cd-99ca-99e573353e9f', 'volume_size': 1, 'image_id': '35abbd28-c346-49e4-837f-67f356c644b2', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8559624b6f20b8730c41d9ea52a4d267', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c76061403d6945228f8eb6d0f8e915e0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0f32a9d87ef4f84ea88955949c22ff1b91dddbca35b06eabd892ede72118a8c91f337928510164ab717a3621b2a0dcebde8130cd2641a3c56acede8e9bb73755', 'id': '35abbd28-c346-49e4-837f-67f356c644b2', 'created_at': datetime.datetime(2025, 9, 18, 20, 28, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 20, 28, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35abbd28-c346-49e4-837f-67f356c644b2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f905469dc30>}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c78eb82-1df3-4ccf-82fe-864e900380d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c78eb82-1df3-4ccf-82fe-864e900380d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e44e6a0-6cbd-4f19-8ac4-839cff5d5c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:11 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Volume 0a375337-534d-44cd-99ca-99e573353e9f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0a375337-534d-44cd-99ca-99e573353e9f', 'volume_size': 1, 'image_id': '35abbd28-c346-49e4-837f-67f356c644b2', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8559624b6f20b8730c41d9ea52a4d267', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c76061403d6945228f8eb6d0f8e915e0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0f32a9d87ef4f84ea88955949c22ff1b91dddbca35b06eabd892ede72118a8c91f337928510164ab717a3621b2a0dcebde8130cd2641a3c56acede8e9bb73755', 'id': '35abbd28-c346-49e4-837f-67f356c644b2', 'created_at': datetime.datetime(2025, 9, 18, 20, 28, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 20, 28, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35abbd28-c346-49e4-837f-67f356c644b2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f905469dc30>}
Sep 18 22:28:11 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Cloning 0a375337-534d-44cd-99ca-99e573353e9f from image 35abbd28-c346-49e4-837f-67f356c644b2  at location (None, None). {{(pid=83342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 18 22:28:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Acquiring lock "cinder-262a583c-dac9-4caa-8d00-c529bbcf9be4-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:28:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Lock "cinder-262a583c-dac9-4caa-8d00-c529bbcf9be4-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:28:11 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 22:28:11 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Image download 0.00 MB at 0.00 MB/s
Sep 18 22:28:12 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:28:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Acquiring lock "cinder-quobyte-262a583c-dac9-4caa-8d00-c529bbcf9be4" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:28:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Lock "cinder-quobyte-262a583c-dac9-4caa-8d00-c529bbcf9be4" acquired by "delete_volume" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:28:12 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17e10b8-8bce-48f6-91fa-f9e5e7b05da1]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:28:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-262a583c-dac9-4caa-8d00-c529bbcf9be4 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:12 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8df70f-898b-4c9c-9ac0-a4a96026371d]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:28:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-262a583c-dac9-4caa-8d00-c529bbcf9be4" returned: 0 in 0.554s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-262a583c-dac9-4caa-8d00-c529bbcf9be4 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-262a583c-dac9-4caa-8d00-c529bbcf9be4" returned: 0 in 0.121s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:12 devstack sudo[97510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD
Sep 18 22:28:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Lock "cinder-quobyte-262a583c-dac9-4caa-8d00-c529bbcf9be4" released by "delete_volume" :: held 0.844s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:28:12 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:28:13 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Created reservations ['2b8ebfe5-9fd8-4d48-9f5d-6de4b5db34fa', 'f1c47170-9e96-40fa-ba70-2a93c8f6423a', '139ea0dd-86da-45f6-bf7a-8af938692cf1', '83efb8cb-5760-47ea-8743-b999b6fdd00d'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:28:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:28:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:28:13 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:28:13 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:28:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:28:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.135s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:13 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:28:13 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Deleted volume successfully.
Sep 18 22:28:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-57d77e47-b0c1-44d8-b972-210ddc6126c5 tempest-VolumeQuotasNegativeTestJSON-338338475 None] Lock "cinder-262a583c-dac9-4caa-8d00-c529bbcf9be4-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:28:14 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root
Sep 18 22:28:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD" returned: 0 in 2.470s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:15 devstack sudo[97518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD
Sep 18 22:28:15 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:28:16 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root
Sep 18 22:28:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD" returned: 1 in 2.062s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:28:16 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Temporary image 35abbd28-c346-49e4-837f-67f356c644b2 is fetched for user d51a8ec6c5d04f13a404f43f3507b38d. {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 22:28:17 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=89,cinder:INSERT=25,cinder:UPDATE=140,cinder:DELETE=10 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:28:17 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=99,cinder:INSERT=26,cinder:UPDATE=118,cinder:DELETE=9 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:28:17 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec98ed9-865e-45db-8a99-7a8165625db6]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:28:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:17 devstack sudo[97523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD
Sep 18 22:28:17 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:28:19 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root
Sep 18 22:28:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD" returned: 0 in 2.325s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:20 devstack sudo[97527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD
Sep 18 22:28:20 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:28:20 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Flow 'volume_create_manager' (2ec8faee-de7c-4fe5-bcee-416783b4cb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e449717-d028-4760-9a7f-a8a35649dc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e449717-d028-4760-9a7f-a8a35649dc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1837209868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45daf061-02b9-492c-bbae-4da0cdf1c16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='103972bb891742d39a6173293bee9190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:28:20Z,use_quota=True,user_id='c5eb9193a57b4da0989616836bf7aeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d600388-f83b-4b81-a3c9-643a1105e77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d600388-f83b-4b81-a3c9-643a1105e77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eebda11-54d9-4a7d-bb0b-eeac9b6637e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eebda11-54d9-4a7d-bb0b-eeac9b6637e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45daf061-02b9-492c-bbae-4da0cdf1c16d', 'volume_name': 'volume-45daf061-02b9-492c-bbae-4da0cdf1c16d', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93653db-85c3-46f8-8472-cef8a435f461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93653db-85c3-46f8-8472-cef8a435f461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75723b6-4a48-4e8a-a0cf-cc21ad54c79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:20 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Volume 45daf061-02b9-492c-bbae-4da0cdf1c16d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45daf061-02b9-492c-bbae-4da0cdf1c16d', 'volume_size': 1}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1837209868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45daf061-02b9-492c-bbae-4da0cdf1c16d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='103972bb891742d39a6173293bee9190',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:28:20Z,use_quota=True,user_id='c5eb9193a57b4da0989616836bf7aeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Creating volume 45daf061-02b9-492c-bbae-4da0cdf1c16d {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:28:20 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:28:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-45daf061-02b9-492c-bbae-4da0cdf1c16d 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:21 devstack quobyte-client[83360]: System call of process 97529 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:28:21 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=110, name=volume-45daf061-02b9-492c-bbae-4da0cdf1c16d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:28:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-45daf061-02b9-492c-bbae-4da0cdf1c16d 1073741824" returned: 0 in 0.419s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-45daf061-02b9-492c-bbae-4da0cdf1c16d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-45daf061-02b9-492c-bbae-4da0cdf1c16d" returned: 0 in 0.139s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] <== create_volume: return (645ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:28:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.658s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:28:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75723b6-4a48-4e8a-a0cf-cc21ad54c79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45daf061-02b9-492c-bbae-4da0cdf1c16d', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84ff1db-b8a6-4624-8946-4299d0f08093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:21 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Volume volume-45daf061-02b9-492c-bbae-4da0cdf1c16d (45daf061-02b9-492c-bbae-4da0cdf1c16d): created successfully
Sep 18 22:28:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84ff1db-b8a6-4624-8946-4299d0f08093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Flow 'volume_create_manager' (2ec8faee-de7c-4fe5-bcee-416783b4cb0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:28:22 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-72640a81-55a6-4b0c-a38c-66aac678b0ed tempest-VolumesServicesTestJSON-1701864491 None] Created volume successfully.
Sep 18 22:28:22 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD" returned: 1 in 2.539s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a375337-534d-44cd-99ca-99e573353e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c76061403d6945228f8eb6d0f8e915e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:28:11Z,use_quota=True,user_id='d51a8ec6c5d04f13a404f43f3507b38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Creating volume 0a375337-534d-44cd-99ca-99e573353e9f {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:28:22 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:22 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=111, name=volume-0a375337-534d-44cd-99ca-99e573353e9f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f 1073741824" returned: 0 in 0.352s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Acquiring lock "cinder-45daf061-02b9-492c-bbae-4da0cdf1c16d-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f" returned: 0 in 0.358s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] <== create_volume: return (781ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:28:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:28:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Lock "cinder-45daf061-02b9-492c-bbae-4da0cdf1c16d-delete_volume" acquired by "delete_volume" :: waited 0.265s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:28:23 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:28:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Acquiring lock "cinder-quobyte-45daf061-02b9-492c-bbae-4da0cdf1c16d" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:28:23 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Attempting download of 35abbd28-c346-49e4-837f-67f356c644b2 ((None, None)) to volume 0a375337-534d-44cd-99ca-99e573353e9f. {{(pid=83342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 22:28:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Lock "cinder-quobyte-45daf061-02b9-492c-bbae-4da0cdf1c16d" acquired by "delete_volume" :: waited 0.096s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:28:23 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d852dd61-6c55-4d90-bf37-7265f5a1c79f]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:28:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-45daf061-02b9-492c-bbae-4da0cdf1c16d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:23 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df0f03f-20e1-4ef4-ab0f-0cd63fc73f16]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:28:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35abbd28-c346-49e4-837f-67f356c644b2_ay6pfryn {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-45daf061-02b9-492c-bbae-4da0cdf1c16d" returned: 0 in 0.643s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-45daf061-02b9-492c-bbae-4da0cdf1c16d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-45daf061-02b9-492c-bbae-4da0cdf1c16d" returned: 0 in 0.100s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:24 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Lock "cinder-quobyte-45daf061-02b9-492c-bbae-4da0cdf1c16d" released by "delete_volume" :: held 0.963s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:28:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35abbd28-c346-49e4-837f-67f356c644b2_ay6pfryn" returned: 0 in 0.767s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35abbd28-c346-49e4-837f-67f356c644b2_ay6pfryn {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:24 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Created reservations ['b3bc9ed4-2e72-4d1f-bc69-1f918bcaea59', 'a1fb814c-f610-4a97-ac08-998d10cf5cfa', '438805c9-5368-4baf-8af9-d1741ed063d9', 'b2dfac70-ed20-4839-9fa7-e1287be6438d'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:28:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35abbd28-c346-49e4-837f-67f356c644b2_ay6pfryn" returned: 1 in 0.510s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35abbd28-c346-49e4-837f-67f356c644b2_ay6pfryn' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:28:25 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1ea1c8-d50c-40f1-b2cf-1036a434550c]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:28:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:28:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:28:25 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:28:25 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:28:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:28:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.114s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:25 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:28:25 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Deleted volume successfully.
Sep 18 22:28:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD" returned: 0 in 0.694s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-de086838-59ab-4848-91f5-326042ee7c74 tempest-VolumesServicesTestJSON-1701864491 None] Lock "cinder-45daf061-02b9-492c-bbae-4da0cdf1c16d-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:28:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD" returned: 1 in 0.515s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:28:26 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] 35abbd28-c346-49e4-837f-67f356c644b2 was raw, converting to raw {{(pid=83342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 22:28:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:26 devstack quobyte-client[83360]: System call of process 97587 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:28:26 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=111, name=volume-0a375337-534d-44cd-99ca-99e573353e9f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:28:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f" returned: 0 in 0.197s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:26 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35abbd28-c346-49e4-837f-67f356c644b2_zdh1hcdbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f {{(pid=83342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 22:28:26 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Converted 0.00 MB image at 0.00 MB/s
Sep 18 22:28:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:26 devstack quobyte-client[83360]: System call of process 97590 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:28:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f 1G" returned: 0 in 0.155s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:26 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd885586-3736-4628-8953-4d0245626c30]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:28:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f" returned: 0 in 0.429s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f" returned: 1 in 0.446s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:28:27 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Downloaded image 35abbd28-c346-49e4-837f-67f356c644b2 ((None, None)) to volume 0a375337-534d-44cd-99ca-99e573353e9f successfully. {{(pid=83342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 22:28:27 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Temporary image 35abbd28-c346-49e4-837f-67f356c644b2 for user d51a8ec6c5d04f13a404f43f3507b38d is deleted. {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 22:28:27 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Marking volume 0a375337-534d-44cd-99ca-99e573353e9f as bootable. {{(pid=83342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 22:28:28 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Copying metadata from image 35abbd28-c346-49e4-837f-67f356c644b2 to 0a375337-534d-44cd-99ca-99e573353e9f. {{(pid=83342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 22:28:28 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Creating volume glance metadata for volume 0a375337-534d-44cd-99ca-99e573353e9f backed by image 35abbd28-c346-49e4-837f-67f356c644b2 with: {'image_id': '35abbd28-c346-49e4-837f-67f356c644b2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8559624b6f20b8730c41d9ea52a4d267', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 22:28:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e44e6a0-6cbd-4f19-8ac4-839cff5d5c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a375337-534d-44cd-99ca-99e573353e9f', 'volume_size': 1, 'image_id': '35abbd28-c346-49e4-837f-67f356c644b2', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8559624b6f20b8730c41d9ea52a4d267', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c76061403d6945228f8eb6d0f8e915e0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0f32a9d87ef4f84ea88955949c22ff1b91dddbca35b06eabd892ede72118a8c91f337928510164ab717a3621b2a0dcebde8130cd2641a3c56acede8e9bb73755', 'id': '35abbd28-c346-49e4-837f-67f356c644b2', 'created_at': datetime.datetime(2025, 9, 18, 20, 28, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 20, 28, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35abbd28-c346-49e4-837f-67f356c644b2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f905469dc30>}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cddaf600-0b8f-4ec5-8ded-a343f129562d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:28 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Volume volume-0a375337-534d-44cd-99ca-99e573353e9f (0a375337-534d-44cd-99ca-99e573353e9f): created successfully
Sep 18 22:28:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cddaf600-0b8f-4ec5-8ded-a343f129562d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:28 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Flow 'volume_create_manager' (27d05dcd-e382-4390-baa9-5f4dc15fd6de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:28:28 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-5e2ff856-62fc-460f-a5ba-c1ee7dd11a22 tempest-VolumeImageDependencyTests-1908191571 None] Created volume successfully.
Sep 18 22:28:28 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Acquiring lock "cinder-0a375337-534d-44cd-99ca-99e573353e9f-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:28:28 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Lock "cinder-0a375337-534d-44cd-99ca-99e573353e9f-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:28:29 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:28:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Acquiring lock "cinder-quobyte-0a375337-534d-44cd-99ca-99e573353e9f" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:28:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Lock "cinder-quobyte-0a375337-534d-44cd-99ca-99e573353e9f" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:28:29 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5f40a8-c923-4e85-af1d-c4330b2abaa3]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:28:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f" returned: 0 in 0.388s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:29 devstack quobyte-client[83360]: System call of process 97600 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:28:29 devstack quobyte-client[83360]: System call of process 97600 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:28:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f" returned: 1 in 0.415s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:28:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0a375337-534d-44cd-99ca-99e573353e9f" returned: 0 in 0.096s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Lock "cinder-quobyte-0a375337-534d-44cd-99ca-99e573353e9f" released by "delete_volume" :: held 1.207s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:28:30 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Created reservations ['28feba9e-765d-44f6-8b4f-ad47c83ff765', 'e779306b-1104-464c-aa42-7c68cd6a10b9', 'ddea8da3-ae65-4793-a841-c3bc6ece8691', '917b2ec8-af80-4c68-b415-264b47754ce8'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:28:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:28:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:28:30 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:28:30 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:28:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:28:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.104s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:30 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:28:31 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Deleted volume successfully.
Sep 18 22:28:31 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e97e36c6-beaa-47a8-b28a-a8feaad4b136 tempest-VolumeImageDependencyTests-1908191571 None] Lock "cinder-0a375337-534d-44cd-99ca-99e573353e9f-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:28:40 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=17,cinder:DELETE=2,cinder:INSERT=6,cinder:UPDATE=22 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:28:41 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:INSERT=11,cinder:UPDATE=20,cinder:SELECT=14,cinder:DELETE=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:28:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:28:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:28:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:28:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:28:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:28:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:28:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.110s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:28:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:28:59 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Flow 'volume_create_manager' (846a2c54-9bcb-4258-a534-46c3d72249a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a622ecf-65f6-44de-acb4-546d0b93e4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a622ecf-65f6-44de-acb4-546d0b93e4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-509923750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0494ad1f-87bc-4746-b0bc-f73332bf99d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c76c861a705465ea31efd6c8ec8e036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:28:59Z,use_quota=True,user_id='e5cb73e0801c416aaf7519b4622391b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f29741f-8dd1-4547-8786-d9b7379de6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f29741f-8dd1-4547-8786-d9b7379de6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a465bc6-5c44-4627-9f3f-a9cb2f6ce064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a465bc6-5c44-4627-9f3f-a9cb2f6ce064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0494ad1f-87bc-4746-b0bc-f73332bf99d9', 'volume_name': 'volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58f791b-d28e-4859-bee8-8edd79d5dc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58f791b-d28e-4859-bee8-8edd79d5dc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20e0e61-d74d-4536-896d-e7c0322d38a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:28:59 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Volume 0494ad1f-87bc-4746-b0bc-f73332bf99d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9', 'volume_size': 1}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-509923750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0494ad1f-87bc-4746-b0bc-f73332bf99d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c76c861a705465ea31efd6c8ec8e036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:28:59Z,use_quota=True,user_id='e5cb73e0801c416aaf7519b4622391b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Creating volume 0494ad1f-87bc-4746-b0bc-f73332bf99d9 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:28:59 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:28:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:28:59 devstack quobyte-client[83360]: System call of process 97617 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:28:59 devstack quobyte-client[83360]: System call of process 97617 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:28:59 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=112, name=volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:29:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 1073741824" returned: 0 in 0.351s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9" returned: 0 in 0.186s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:00 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] <== create_volume: return (602ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:29:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.613s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:29:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20e0e61-d74d-4536-896d-e7c0322d38a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:29:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854390fb-103b-41c1-861d-143ef95b4b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:29:00 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Volume volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 (0494ad1f-87bc-4746-b0bc-f73332bf99d9): created successfully
Sep 18 22:29:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854390fb-103b-41c1-861d-143ef95b4b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:29:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Flow 'volume_create_manager' (846a2c54-9bcb-4258-a534-46c3d72249a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:29:00 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-d96da44e-c25f-4ca2-b177-6b2110ba596c tempest-SnapshotDependencyTests-808155071 None] Created volume successfully.
Sep 18 22:29:01 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:29:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:29:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:29:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] Creating offline snapshot 5292f17d-fa78-4739-811e-e2d39df55cb8 of volume 0494ad1f-87bc-4746-b0bc-f73332bf99d9 {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:29:01 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8153322-d455-4dfb-a824-577a0852185a]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:29:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:02 devstack quobyte-client[83360]: System call of process 97624 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:29:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9" returned: 0 in 0.468s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:02 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=113, name=volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:29:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8 1G" returned: 0 in 0.264s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:02 devstack quobyte-client[83360]: System call of process 97630 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:29:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] CMD "qemu-img rebase -u -b volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8" returned: 0 in 0.153s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:29:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8" returned: 0 in 0.122s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:03 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:29:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8" returned: 0 in 0.106s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.info" returned: 0 in 0.098s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:03 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:29:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.info" returned: 0 in 0.088s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.710s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:29:03 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-71d5ffb5-1ae4-44f8-85e4-86d03ad32e98 tempest-SnapshotDependencyTests-808155071 None] Create snapshot completed successfully
Sep 18 22:29:05 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Flow 'volume_create_manager' (3e0ea41c-c4f4-46d2-b8c3-67cbc3a043ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6a495c-d448-46aa-938b-3f2fd4ab0e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6a495c-d448-46aa-938b-3f2fd4ab0e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a336d4cd-5bf5-4d48-8a35-22d76488f133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c76c861a705465ea31efd6c8ec8e036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5292f17d-fa78-4739-811e-e2d39df55cb8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:29:05Z,use_quota=True,user_id='e5cb73e0801c416aaf7519b4622391b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f326de67-12b8-4863-a631-094cf8ae9f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f326de67-12b8-4863-a631-094cf8ae9f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ce5de6-14b7-47f3-b14e-dac9f5da90f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ce5de6-14b7-47f3-b14e-dac9f5da90f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a336d4cd-5bf5-4d48-8a35-22d76488f133', 'volume_name': 'volume-a336d4cd-5bf5-4d48-8a35-22d76488f133', 'volume_size': 1, 'snapshot_id': '5292f17d-fa78-4739-811e-e2d39df55cb8'}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb70ac4-9a42-4f2d-b0e7-2dfe9f9ddaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbb70ac4-9a42-4f2d-b0e7-2dfe9f9ddaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3093e9e3-6dad-4940-847e-2c0fb7460223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:29:05 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Volume a336d4cd-5bf5-4d48-8a35-22d76488f133: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a336d4cd-5bf5-4d48-8a35-22d76488f133', 'volume_size': 1, 'snapshot_id': '5292f17d-fa78-4739-811e-e2d39df55cb8'}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "cinder-quobyte-5292f17d-fa78-4739-811e-e2d39df55cb8-a336d4cd-5bf5-4d48-8a35-22d76488f133" by "_create_volume_from_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-quobyte-5292f17d-fa78-4739-811e-e2d39df55cb8-a336d4cd-5bf5-4d48-8a35-22d76488f133" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Creating volume a336d4cd-5bf5-4d48-8a35-22d76488f133 from snapshot 5292f17d-fa78-4739-811e-e2d39df55cb8 {{(pid=83342) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "cinder-quobyte-a336d4cd-5bf5-4d48-8a35-22d76488f133" by "_copy_volume_from_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-quobyte-a336d4cd-5bf5-4d48-8a35-22d76488f133" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:29:05 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] snapshot: 5292f17d-fa78-4739-811e-e2d39df55cb8, volume: a336d4cd-5bf5-4d48-8a35-22d76488f133,  {{(pid=83342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 22:29:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:29:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:29:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:29:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:29:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:29:06 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c781a9-6bcf-4924-a462-b988a9c066f1]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:29:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:06 devstack quobyte-client[83360]: System call of process 97637 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:29:06 devstack quobyte-client[83360]: System call of process 97637 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:29:06 devstack quobyte-client[83360]: System call of process 97637 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:29:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8" returned: 0 in 0.696s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:29:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 {{(pid=83342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 22:29:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Creating direct copy from snapshot {{(pid=83342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 22:29:06 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e4334b-8f69-4ee6-b384-89dac5d5464f]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:29:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9" returned: 0 in 0.460s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:07 devstack cinder-volume[83342]: DEBUG cinder.utils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a336d4cd-5bf5-4d48-8a35-22d76488f133 not found in is_blk_device check {{(pid=83342) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 22:29:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a336d4cd-5bf5-4d48-8a35-22d76488f133 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:07 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=115, name=volume-a336d4cd-5bf5-4d48-8a35-22d76488f133, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:29:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a336d4cd-5bf5-4d48-8a35-22d76488f133" returned: 0 in 5.218s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:12 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60f8704-1093-43c9-a402-d9cb8f9f305b]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:29:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9" returned: 0 in 0.757s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:13 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Image conversion details: src /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9, size 1024.00 MB, duration 5.26 sec, destination /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a336d4cd-5bf5-4d48-8a35-22d76488f133 {{(pid=83342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 22:29:13 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Converted 1024.00 MB image at 194.71 MB/s
Sep 18 22:29:13 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a336d4cd-5bf5-4d48-8a35-22d76488f133 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:29:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a336d4cd-5bf5-4d48-8a35-22d76488f133 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a336d4cd-5bf5-4d48-8a35-22d76488f133" returned: 0 in 0.102s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-quobyte-a336d4cd-5bf5-4d48-8a35-22d76488f133" released by "_copy_volume_from_snapshot" :: held 7.726s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:29:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-quobyte-5292f17d-fa78-4739-811e-e2d39df55cb8-a336d4cd-5bf5-4d48-8a35-22d76488f133" released by "_create_volume_from_snapshot" :: held 7.791s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:29:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.820s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:29:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3093e9e3-6dad-4940-847e-2c0fb7460223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a336d4cd-5bf5-4d48-8a35-22d76488f133', 'volume_size': 1, 'snapshot_id': '5292f17d-fa78-4739-811e-e2d39df55cb8'}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:29:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46137956-b3eb-47e9-a930-61068dfe0bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:29:14 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Volume volume-a336d4cd-5bf5-4d48-8a35-22d76488f133 (a336d4cd-5bf5-4d48-8a35-22d76488f133): created successfully
Sep 18 22:29:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46137956-b3eb-47e9-a930-61068dfe0bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:29:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Flow 'volume_create_manager' (3e0ea41c-c4f4-46d2-b8c3-67cbc3a043ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:29:14 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-4cd923a2-79bb-4faf-a516-972debe3803a tempest-SnapshotDependencyTests-808155071 None] Created volume successfully.
Sep 18 22:29:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "cinder-5292f17d-fa78-4739-811e-e2d39df55cb8-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:29:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-5292f17d-fa78-4739-811e-e2d39df55cb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:29:15 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:29:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "cinder-quobyte-0494ad1f-87bc-4746-b0bc-f73332bf99d9" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:29:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-quobyte-0494ad1f-87bc-4746-b0bc-f73332bf99d9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:29:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "cinder-quobyte-5292f17d-fa78-4739-811e-e2d39df55cb8" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:29:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-quobyte-5292f17d-fa78-4739-811e-e2d39df55cb8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:29:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Deleting offline snapshot 5292f17d-fa78-4739-811e-e2d39df55cb8 of volume 0494ad1f-87bc-4746-b0bc-f73332bf99d9 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:29:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] snapshot_file for this snap is: volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:29:15 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[97506454-a412-4c31-8f4f-5785306e8269]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:29:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:15 devstack quobyte-client[83360]: System call of process 97660 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:29:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8" returned: 0 in 0.537s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:29:15 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[396eab82-6aee-487e-b2db-32d80b3680d1]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:29:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9" returned: 0 in 0.418s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:16 devstack quobyte-client[83360]: System call of process 97666 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:29:16 devstack quobyte-client[83360]: System call of process 97666 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:29:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8" returned: 0 in 0.298s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9.5292f17d-fa78-4739-811e-e2d39df55cb8" returned: 0 in 0.102s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-quobyte-5292f17d-fa78-4739-811e-e2d39df55cb8" released by "_delete_snapshot" :: held 1.755s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:29:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-quobyte-0494ad1f-87bc-4746-b0bc-f73332bf99d9" released by "delete_snapshot" :: held 1.780s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:29:17 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Created reservations ['0b9b1eff-7744-4d32-8c76-cced738e69bc', '4debab68-b476-4951-bc5c-1c60f4457e8f', '93b2a0d6-918a-459d-a3df-9c66eddacc8c', '57d1b2a2-fe2f-4498-8960-d9966343441b'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:29:17 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Delete snapshot completed successfully.
Sep 18 22:29:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-23cfa3b4-8597-492a-8e28-9dc44a54890e tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-5292f17d-fa78-4739-811e-e2d39df55cb8-delete_snapshot" released by "delete_snapshot" :: held 2.246s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:29:18 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "cinder-0494ad1f-87bc-4746-b0bc-f73332bf99d9-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:29:18 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-0494ad1f-87bc-4746-b0bc-f73332bf99d9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:29:18 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:29:18 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "cinder-quobyte-0494ad1f-87bc-4746-b0bc-f73332bf99d9" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:29:18 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-quobyte-0494ad1f-87bc-4746-b0bc-f73332bf99d9" acquired by "delete_volume" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:29:18 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3792e2-b880-46c1-a3ba-36dadcbf4b3d]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:29:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9" returned: 0 in 0.588s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-0494ad1f-87bc-4746-b0bc-f73332bf99d9" returned: 0 in 0.121s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:19 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-quobyte-0494ad1f-87bc-4746-b0bc-f73332bf99d9" released by "delete_volume" :: held 0.981s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:29:19 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Created reservations ['428aa70c-c81a-47bd-940e-31f8687c20eb', '2f723f52-9ee3-456c-b9b9-ef962140899d', '89ead119-352b-4792-80d1-329fb6fc4f24', 'b7d038c4-b5f5-4ac5-80af-066a6afc8a7e'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:29:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:29:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:29:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:29:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:29:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:29:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.100s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:20 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:29:20 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Deleted volume successfully.
Sep 18 22:29:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e15fba6e-71e2-4944-986f-26e9a66d3cb7 tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-0494ad1f-87bc-4746-b0bc-f73332bf99d9-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:29:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "cinder-a336d4cd-5bf5-4d48-8a35-22d76488f133-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:29:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-a336d4cd-5bf5-4d48-8a35-22d76488f133-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:29:20 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:29:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "cinder-quobyte-a336d4cd-5bf5-4d48-8a35-22d76488f133" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:29:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-quobyte-a336d4cd-5bf5-4d48-8a35-22d76488f133" acquired by "delete_volume" :: waited 0.016s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:29:20 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b78a03-58e9-428c-9585-b53f07138d61]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:29:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a336d4cd-5bf5-4d48-8a35-22d76488f133 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a336d4cd-5bf5-4d48-8a35-22d76488f133" returned: 0 in 0.395s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a336d4cd-5bf5-4d48-8a35-22d76488f133 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a336d4cd-5bf5-4d48-8a35-22d76488f133" returned: 0 in 0.087s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-quobyte-a336d4cd-5bf5-4d48-8a35-22d76488f133" released by "delete_volume" :: held 0.650s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:29:21 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Created reservations ['2cd091c2-7f52-48df-9df7-c27da7045e0e', '52b5b8e6-56cf-4783-ac5d-b8d76fdeac89', '3bdec4c3-608b-4394-8ca9-a21ec1ba2445', 'a21929b7-dc83-4d43-b8bf-93512873abc7'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:29:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:29:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:29:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:29:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:29:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:29:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.114s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:22 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:29:22 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Deleted volume successfully.
Sep 18 22:29:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4ebbbb1f-c4f8-4fcc-b44b-7af604cdd3a3 tempest-SnapshotDependencyTests-808155071 None] Lock "cinder-a336d4cd-5bf5-4d48-8a35-22d76488f133-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:29:35 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=22,cinder:UPDATE=17,cinder:DELETE=3,cinder:INSERT=7 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:29:35 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=37,cinder:DELETE=2,cinder:SELECT=18,cinder:INSERT=5 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:29:43 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Flow 'volume_create_manager' (ff0ed83f-3846-43a6-a7e8-fa9b76f0ad02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc5aa91-fbd7-4a48-91a4-ef1181da66f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc5aa91-fbd7-4a48-91a4-ef1181da66f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-111722794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7bc325-412a-47f7-b63c-df138036eeee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f281853a4e4be688f8d03f8cc8be5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:29:43Z,use_quota=True,user_id='482b4d70488746f5afbf99e8829164c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763def3b-66c3-4a84-b913-61b9c59588ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (763def3b-66c3-4a84-b913-61b9c59588ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6dd11b6-8465-4959-a72f-80a3b310c8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6dd11b6-8465-4959-a72f-80a3b310c8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c7bc325-412a-47f7-b63c-df138036eeee', 'volume_name': 'volume-5c7bc325-412a-47f7-b63c-df138036eeee', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34283a9-9e3a-4f31-9cef-7d5862536c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34283a9-9e3a-4f31-9cef-7d5862536c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589559b0-f695-4c42-9b1e-760b8d5d95b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:29:43 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Volume 5c7bc325-412a-47f7-b63c-df138036eeee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c7bc325-412a-47f7-b63c-df138036eeee', 'volume_size': 1}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:29:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-111722794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c7bc325-412a-47f7-b63c-df138036eeee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f281853a4e4be688f8d03f8cc8be5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:29:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:29:43Z,use_quota=True,user_id='482b4d70488746f5afbf99e8829164c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Creating volume 5c7bc325-412a-47f7-b63c-df138036eeee {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:29:43 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c7bc325-412a-47f7-b63c-df138036eeee 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:43 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=116, name=volume-5c7bc325-412a-47f7-b63c-df138036eeee, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:29:43 devstack quobyte-client[83360]: System call of process 97821 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:29:43 devstack quobyte-client[83360]: System call of process 97821 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c7bc325-412a-47f7-b63c-df138036eeee 1073741824" returned: 0 in 0.360s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c7bc325-412a-47f7-b63c-df138036eeee {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c7bc325-412a-47f7-b63c-df138036eeee" returned: 0 in 0.089s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] <== create_volume: return (549ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:29:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.562s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:29:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589559b0-f695-4c42-9b1e-760b8d5d95b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c7bc325-412a-47f7-b63c-df138036eeee', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:29:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33101d6-3218-47fe-98af-52e096f5db37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:29:44 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Volume volume-5c7bc325-412a-47f7-b63c-df138036eeee (5c7bc325-412a-47f7-b63c-df138036eeee): created successfully
Sep 18 22:29:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b33101d6-3218-47fe-98af-52e096f5db37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:29:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Flow 'volume_create_manager' (ff0ed83f-3846-43a6-a7e8-fa9b76f0ad02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:29:44 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-36676992-31f7-429a-b3b0-1d47c651c25a tempest-VolumesActionsTest-1570088156 None] Created volume successfully.
Sep 18 22:29:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-41214745-fd8a-4cda-a307-ba1b1e22b2d3 tempest-VolumesActionsTest-1570088156 None] Acquiring lock "cinder-5c7bc325-412a-47f7-b63c-df138036eeee" by "attach_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:29:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-41214745-fd8a-4cda-a307-ba1b1e22b2d3 tempest-VolumesActionsTest-1570088156 None] Lock "cinder-5c7bc325-412a-47f7-b63c-df138036eeee" acquired by "attach_volume" :: waited 0.064s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:29:45 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-41214745-fd8a-4cda-a307-ba1b1e22b2d3 tempest-VolumesActionsTest-1570088156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:29:45 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-41214745-fd8a-4cda-a307-ba1b1e22b2d3 tempest-VolumesActionsTest-1570088156 None] Attaching volume 5c7bc325-412a-47f7-b63c-df138036eeee to instance f5d7b024-3f0c-4095-86a9-09239ae0f686 at mountpoint /dev/vdb on host None.
Sep 18 22:29:45 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-41214745-fd8a-4cda-a307-ba1b1e22b2d3 tempest-VolumesActionsTest-1570088156 None] Attach volume completed successfully.
Sep 18 22:29:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-41214745-fd8a-4cda-a307-ba1b1e22b2d3 tempest-VolumesActionsTest-1570088156 None] Lock "cinder-5c7bc325-412a-47f7-b63c-df138036eeee" released by "attach_volume" :: held 0.220s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:29:46 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e89edc6e-7d8e-4028-be26-d8b1bcf2a7a1 tempest-VolumesActionsTest-2078200964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:29:46 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e89edc6e-7d8e-4028-be26-d8b1bcf2a7a1 tempest-VolumesActionsTest-2078200964 None] Terminate volume connection completed successfully.
Sep 18 22:29:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e89edc6e-7d8e-4028-be26-d8b1bcf2a7a1 tempest-VolumesActionsTest-2078200964 None] Acquiring lock "cinder-5c7bc325-412a-47f7-b63c-df138036eeee-detach_volume" by "detach_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:29:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e89edc6e-7d8e-4028-be26-d8b1bcf2a7a1 tempest-VolumesActionsTest-2078200964 None] Lock "cinder-5c7bc325-412a-47f7-b63c-df138036eeee-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:29:46 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e89edc6e-7d8e-4028-be26-d8b1bcf2a7a1 tempest-VolumesActionsTest-2078200964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:29:46 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e89edc6e-7d8e-4028-be26-d8b1bcf2a7a1 tempest-VolumesActionsTest-2078200964 None] Detaching volume 5c7bc325-412a-47f7-b63c-df138036eeee from instance f5d7b024-3f0c-4095-86a9-09239ae0f686.
Sep 18 22:29:46 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e89edc6e-7d8e-4028-be26-d8b1bcf2a7a1 tempest-VolumesActionsTest-2078200964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:29:46 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e89edc6e-7d8e-4028-be26-d8b1bcf2a7a1 tempest-VolumesActionsTest-2078200964 None] Detach volume completed successfully.
Sep 18 22:29:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e89edc6e-7d8e-4028-be26-d8b1bcf2a7a1 tempest-VolumesActionsTest-2078200964 None] Lock "cinder-5c7bc325-412a-47f7-b63c-df138036eeee-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:29:47 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-28d043d2-bb20-4046-bb31-249f642a89c1 tempest-VolumesActionsTest-1570088156 None] Acquiring lock "cinder-5c7bc325-412a-47f7-b63c-df138036eeee-detach_volume" by "detach_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:29:47 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-28d043d2-bb20-4046-bb31-249f642a89c1 tempest-VolumesActionsTest-1570088156 None] Lock "cinder-5c7bc325-412a-47f7-b63c-df138036eeee-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:29:47 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-28d043d2-bb20-4046-bb31-249f642a89c1 tempest-VolumesActionsTest-1570088156 None] Volume detach called, but volume not attached.
Sep 18 22:29:47 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-28d043d2-bb20-4046-bb31-249f642a89c1 tempest-VolumesActionsTest-1570088156 None] Lock "cinder-5c7bc325-412a-47f7-b63c-df138036eeee-detach_volume" released by "detach_volume" :: held 0.050s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:29:48 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Acquiring lock "cinder-5c7bc325-412a-47f7-b63c-df138036eeee-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:29:48 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Lock "cinder-5c7bc325-412a-47f7-b63c-df138036eeee-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:29:48 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:29:48 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Acquiring lock "cinder-quobyte-5c7bc325-412a-47f7-b63c-df138036eeee" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:29:48 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Lock "cinder-quobyte-5c7bc325-412a-47f7-b63c-df138036eeee" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:29:48 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0398f7c2-387d-495e-95a6-e11ad8bb75c0]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:29:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c7bc325-412a-47f7-b63c-df138036eeee {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c7bc325-412a-47f7-b63c-df138036eeee" returned: 0 in 0.456s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c7bc325-412a-47f7-b63c-df138036eeee {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c7bc325-412a-47f7-b63c-df138036eeee" returned: 0 in 0.173s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Lock "cinder-quobyte-5c7bc325-412a-47f7-b63c-df138036eeee" released by "delete_volume" :: held 0.762s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:29:49 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Created reservations ['9811bc82-6e6d-4ef4-a1ed-31886ce720f7', 'bfa1bb87-b261-451b-b049-adbb83bf45ec', 'd8050823-cd63-4e9c-be04-3dfaa35b010e', '0628c817-ac6b-42e2-a799-941c4d2233bd'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:29:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:29:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:29:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:29:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:29:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:29:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:29:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.089s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:29:49 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:29:49 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Deleted volume successfully.
Sep 18 22:29:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-f22d6710-a9f8-43bc-9099-88f711c609c7 tempest-VolumesActionsTest-1570088156 None] Lock "cinder-5c7bc325-412a-47f7-b63c-df138036eeee-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:29:59 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=14,cinder:UPDATE=15,cinder:DELETE=1,cinder:INSERT=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:29:59 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=12,cinder:SELECT=13,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:30:01 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Flow 'volume_create_manager' (4fcc5105-8aae-47e2-b6dd-cc0db05cf8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44887779-04f3-47d1-a921-a0a28516599c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44887779-04f3-47d1-a921-a0a28516599c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-511254023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d56e97-2a2e-4719-8a7d-357cbfcedefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f281853a4e4be688f8d03f8cc8be5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:30:01Z,use_quota=True,user_id='482b4d70488746f5afbf99e8829164c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4601c1-d037-42f5-a9ea-663e05015d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4601c1-d037-42f5-a9ea-663e05015d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b6e286-3958-4234-abd3-b4d8f2254400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b6e286-3958-4234-abd3-b4d8f2254400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69d56e97-2a2e-4719-8a7d-357cbfcedefc', 'volume_name': 'volume-69d56e97-2a2e-4719-8a7d-357cbfcedefc', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fcacb4-16a9-4ff7-adf5-6d28bf17f56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fcacb4-16a9-4ff7-adf5-6d28bf17f56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c527ebdb-0c0b-4a2e-8e53-fc820f41a9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:01 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Volume 69d56e97-2a2e-4719-8a7d-357cbfcedefc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69d56e97-2a2e-4719-8a7d-357cbfcedefc', 'volume_size': 1}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-511254023',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d56e97-2a2e-4719-8a7d-357cbfcedefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f281853a4e4be688f8d03f8cc8be5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:30:01Z,use_quota=True,user_id='482b4d70488746f5afbf99e8829164c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Creating volume 69d56e97-2a2e-4719-8a7d-357cbfcedefc {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:30:01 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:30:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-69d56e97-2a2e-4719-8a7d-357cbfcedefc 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:01 devstack quobyte-client[83360]: System call of process 97917 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:30:01 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=117, name=volume-69d56e97-2a2e-4719-8a7d-357cbfcedefc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:30:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-69d56e97-2a2e-4719-8a7d-357cbfcedefc 1073741824" returned: 0 in 0.340s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-69d56e97-2a2e-4719-8a7d-357cbfcedefc {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-69d56e97-2a2e-4719-8a7d-357cbfcedefc" returned: 0 in 0.086s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] <== create_volume: return (490ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:30:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.502s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c527ebdb-0c0b-4a2e-8e53-fc820f41a9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69d56e97-2a2e-4719-8a7d-357cbfcedefc', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7deba42c-f37a-4723-90bd-8cdccfa2da11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:02 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Volume volume-69d56e97-2a2e-4719-8a7d-357cbfcedefc (69d56e97-2a2e-4719-8a7d-357cbfcedefc): created successfully
Sep 18 22:30:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7deba42c-f37a-4723-90bd-8cdccfa2da11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Flow 'volume_create_manager' (4fcc5105-8aae-47e2-b6dd-cc0db05cf8fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:30:02 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-2b9d6516-58c2-4257-b4af-e4761ce46e62 tempest-VolumesActionsTest-1570088156 None] Created volume successfully.
Sep 18 22:30:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Acquiring lock "cinder-69d56e97-2a2e-4719-8a7d-357cbfcedefc-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:30:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Lock "cinder-69d56e97-2a2e-4719-8a7d-357cbfcedefc-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:30:03 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:30:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Acquiring lock "cinder-quobyte-69d56e97-2a2e-4719-8a7d-357cbfcedefc" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:30:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Lock "cinder-quobyte-69d56e97-2a2e-4719-8a7d-357cbfcedefc" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:30:03 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1860bc07-4fe3-4b5f-b2df-62a36471bedb]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:30:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-69d56e97-2a2e-4719-8a7d-357cbfcedefc {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-69d56e97-2a2e-4719-8a7d-357cbfcedefc" returned: 0 in 0.427s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-69d56e97-2a2e-4719-8a7d-357cbfcedefc {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-69d56e97-2a2e-4719-8a7d-357cbfcedefc" returned: 0 in 0.085s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Lock "cinder-quobyte-69d56e97-2a2e-4719-8a7d-357cbfcedefc" released by "delete_volume" :: held 0.668s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:30:04 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Created reservations ['ee6961d5-5491-411c-8512-db9349fc3807', '42645754-32b4-4d77-96a8-3ecd1a0fa44b', '9bedc778-3f37-48cc-830a-c1cf5ecbfbf9', '09ffe0e5-02d4-40ae-886a-c08eb09b7027'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:30:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:05 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:30:05 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:30:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.086s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:05 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:30:05 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Deleted volume successfully.
Sep 18 22:30:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0487eb6b-066c-41cf-85cc-6892cf76c084 tempest-VolumesActionsTest-2078200964 None] Lock "cinder-69d56e97-2a2e-4719-8a7d-357cbfcedefc-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:30:06 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Flow 'volume_create_manager' (91bde00a-8ab4-485e-b9c2-1a1d9d5f1c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368d952c-7acc-403b-99a8-a06a8a88abc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368d952c-7acc-403b-99a8-a06a8a88abc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1799256138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b079a5-51f3-4444-9032-3f6abe9108eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f281853a4e4be688f8d03f8cc8be5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:30:06Z,use_quota=True,user_id='482b4d70488746f5afbf99e8829164c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0febcfbc-5fe3-4ce8-a585-7a0cbcd48212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0febcfbc-5fe3-4ce8-a585-7a0cbcd48212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2bd054-8e78-4c31-a3ca-56e676626d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2bd054-8e78-4c31-a3ca-56e676626d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30b079a5-51f3-4444-9032-3f6abe9108eb', 'volume_name': 'volume-30b079a5-51f3-4444-9032-3f6abe9108eb', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b30bd2-b6d7-4b54-b409-9e00a3b1232b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b30bd2-b6d7-4b54-b409-9e00a3b1232b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e82e6b-347c-4707-9aad-5484147573b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:06 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Volume 30b079a5-51f3-4444-9032-3f6abe9108eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30b079a5-51f3-4444-9032-3f6abe9108eb', 'volume_size': 1}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1799256138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30b079a5-51f3-4444-9032-3f6abe9108eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f281853a4e4be688f8d03f8cc8be5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:30:06Z,use_quota=True,user_id='482b4d70488746f5afbf99e8829164c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Creating volume 30b079a5-51f3-4444-9032-3f6abe9108eb {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:30:06 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:30:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-30b079a5-51f3-4444-9032-3f6abe9108eb 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:06 devstack quobyte-client[83360]: System call of process 97928 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:30:06 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=118, name=volume-30b079a5-51f3-4444-9032-3f6abe9108eb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:30:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-30b079a5-51f3-4444-9032-3f6abe9108eb 1073741824" returned: 0 in 0.311s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-30b079a5-51f3-4444-9032-3f6abe9108eb {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-30b079a5-51f3-4444-9032-3f6abe9108eb" returned: 0 in 0.105s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:07 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] <== create_volume: return (496ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:30:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.509s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:07 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0e82e6b-347c-4707-9aad-5484147573b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30b079a5-51f3-4444-9032-3f6abe9108eb', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:07 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48ee870-dc04-4eb6-afd5-7685ac0ebb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:07 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Volume volume-30b079a5-51f3-4444-9032-3f6abe9108eb (30b079a5-51f3-4444-9032-3f6abe9108eb): created successfully
Sep 18 22:30:07 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b48ee870-dc04-4eb6-afd5-7685ac0ebb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:07 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Flow 'volume_create_manager' (91bde00a-8ab4-485e-b9c2-1a1d9d5f1c9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:30:07 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-7284c21f-9d1a-4585-b7e1-1db5377b7dbe tempest-VolumesActionsTest-1570088156 None] Created volume successfully.
Sep 18 22:30:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Acquiring lock "cinder-30b079a5-51f3-4444-9032-3f6abe9108eb-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:30:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Lock "cinder-30b079a5-51f3-4444-9032-3f6abe9108eb-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:30:08 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:30:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Acquiring lock "cinder-quobyte-30b079a5-51f3-4444-9032-3f6abe9108eb" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:30:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Lock "cinder-quobyte-30b079a5-51f3-4444-9032-3f6abe9108eb" acquired by "delete_volume" :: waited 0.010s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:30:08 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[78691c27-7fae-4f2a-b35c-d577e894cf77]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:30:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-30b079a5-51f3-4444-9032-3f6abe9108eb {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-30b079a5-51f3-4444-9032-3f6abe9108eb" returned: 0 in 0.383s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-30b079a5-51f3-4444-9032-3f6abe9108eb {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-30b079a5-51f3-4444-9032-3f6abe9108eb" returned: 0 in 0.098s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Lock "cinder-quobyte-30b079a5-51f3-4444-9032-3f6abe9108eb" released by "delete_volume" :: held 0.624s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:30:09 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Created reservations ['f7c32377-a08b-4549-850e-91cfae6e2a7f', 'b22f437e-dba6-4fc7-9ae4-308bd1d6069e', 'c9d0cdb7-a797-4ef9-b9a6-383ea916a24c', 'c29f87fd-ab84-4f25-8211-1327c490c883'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:30:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:30:09 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:30:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.102s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:10 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:30:10 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Deleted volume successfully.
Sep 18 22:30:10 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4c6d2a04-fecd-4fa7-b5e2-9a3640bc6a6f tempest-VolumesActionsTest-2078200964 None] Lock "cinder-30b079a5-51f3-4444-9032-3f6abe9108eb-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:30:11 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Flow 'volume_create_manager' (71b39092-b5bb-4fcf-b215-7c82dd946a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34ff6f4-3da8-4f7c-9248-07a4de5c854c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34ff6f4-3da8-4f7c-9248-07a4de5c854c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-327620899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026f197d-bd0e-4905-9e8b-58f41996737a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f281853a4e4be688f8d03f8cc8be5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:30:11Z,use_quota=True,user_id='482b4d70488746f5afbf99e8829164c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f83f9d7-1cfb-4263-b38a-022faeb8f814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f83f9d7-1cfb-4263-b38a-022faeb8f814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfb75ce-3ea6-4f2e-bf67-fc4f9cf06fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccfb75ce-3ea6-4f2e-bf67-fc4f9cf06fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '026f197d-bd0e-4905-9e8b-58f41996737a', 'volume_name': 'volume-026f197d-bd0e-4905-9e8b-58f41996737a', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad23776-90aa-470c-a276-78a29d606562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fad23776-90aa-470c-a276-78a29d606562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d308fd3-737f-45b9-abc4-1a012e5e62bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:11 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Volume 026f197d-bd0e-4905-9e8b-58f41996737a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-026f197d-bd0e-4905-9e8b-58f41996737a', 'volume_size': 1}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-327620899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=026f197d-bd0e-4905-9e8b-58f41996737a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f281853a4e4be688f8d03f8cc8be5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:30:11Z,use_quota=True,user_id='482b4d70488746f5afbf99e8829164c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Creating volume 026f197d-bd0e-4905-9e8b-58f41996737a {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:30:11 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:30:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-026f197d-bd0e-4905-9e8b-58f41996737a 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:12 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=119, name=volume-026f197d-bd0e-4905-9e8b-58f41996737a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:30:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-026f197d-bd0e-4905-9e8b-58f41996737a 1073741824" returned: 0 in 0.307s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-026f197d-bd0e-4905-9e8b-58f41996737a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-026f197d-bd0e-4905-9e8b-58f41996737a" returned: 0 in 0.095s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] <== create_volume: return (478ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:30:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.495s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d308fd3-737f-45b9-abc4-1a012e5e62bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-026f197d-bd0e-4905-9e8b-58f41996737a', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d45ff0-bb01-4044-9e1c-615f89c8b63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:12 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Volume volume-026f197d-bd0e-4905-9e8b-58f41996737a (026f197d-bd0e-4905-9e8b-58f41996737a): created successfully
Sep 18 22:30:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d45ff0-bb01-4044-9e1c-615f89c8b63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Flow 'volume_create_manager' (71b39092-b5bb-4fcf-b215-7c82dd946a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:30:12 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-910b8743-4893-4899-b15d-a99ee9789660 tempest-VolumesActionsTest-1570088156 None] Created volume successfully.
Sep 18 22:30:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Acquiring lock "cinder-026f197d-bd0e-4905-9e8b-58f41996737a-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:30:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Lock "cinder-026f197d-bd0e-4905-9e8b-58f41996737a-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:30:13 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:30:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Acquiring lock "cinder-quobyte-026f197d-bd0e-4905-9e8b-58f41996737a" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:30:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Lock "cinder-quobyte-026f197d-bd0e-4905-9e8b-58f41996737a" acquired by "delete_volume" :: waited 0.010s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:30:13 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52f3852-6b1f-4a2f-9f5c-a9d89b27c67f]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:30:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-026f197d-bd0e-4905-9e8b-58f41996737a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-026f197d-bd0e-4905-9e8b-58f41996737a" returned: 0 in 0.393s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-026f197d-bd0e-4905-9e8b-58f41996737a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-026f197d-bd0e-4905-9e8b-58f41996737a" returned: 0 in 0.107s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Lock "cinder-quobyte-026f197d-bd0e-4905-9e8b-58f41996737a" released by "delete_volume" :: held 0.652s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:30:14 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Created reservations ['724bfcfc-b17e-46b4-8a0e-6e7d82496404', '962cedd3-6e44-4725-b1c9-7dd2ba0c4cf5', '7bd66d11-fc0b-4e4b-8ead-83b45ae3bf13', '934d96ed-3d7f-41b0-8ae9-3ddde9f691a3'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:30:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:30:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:30:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.107s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:15 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:30:15 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Deleted volume successfully.
Sep 18 22:30:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fb2af74c-1159-470c-880c-dcd5dcdf61ed tempest-VolumesActionsTest-2078200964 None] Lock "cinder-026f197d-bd0e-4905-9e8b-58f41996737a-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:30:16 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Flow 'volume_create_manager' (8d9e071a-8c8c-4db5-9231-8513b6271275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8b879b-b296-44fb-94ac-6839408f5eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8b879b-b296-44fb-94ac-6839408f5eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1074442707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0a511b-509c-47b0-aabd-52662831e46b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f281853a4e4be688f8d03f8cc8be5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:30:16Z,use_quota=True,user_id='482b4d70488746f5afbf99e8829164c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf47b80-9c59-4228-b701-05f06fb6576c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf47b80-9c59-4228-b701-05f06fb6576c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8da26b9-7a74-4ed6-a730-60db627346bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8da26b9-7a74-4ed6-a730-60db627346bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c0a511b-509c-47b0-aabd-52662831e46b', 'volume_name': 'volume-6c0a511b-509c-47b0-aabd-52662831e46b', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0d9a6f-1325-4759-a982-8ff26bf27d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0d9a6f-1325-4759-a982-8ff26bf27d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a694dc-02a7-43db-9efb-b5ed9043a0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:16 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Volume 6c0a511b-509c-47b0-aabd-52662831e46b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c0a511b-509c-47b0-aabd-52662831e46b', 'volume_size': 1}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1074442707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0a511b-509c-47b0-aabd-52662831e46b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f281853a4e4be688f8d03f8cc8be5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:30:16Z,use_quota=True,user_id='482b4d70488746f5afbf99e8829164c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Creating volume 6c0a511b-509c-47b0-aabd-52662831e46b {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:30:16 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c0a511b-509c-47b0-aabd-52662831e46b 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:16 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=120, name=volume-6c0a511b-509c-47b0-aabd-52662831e46b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:30:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c0a511b-509c-47b0-aabd-52662831e46b 1073741824" returned: 0 in 0.314s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c0a511b-509c-47b0-aabd-52662831e46b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c0a511b-509c-47b0-aabd-52662831e46b" returned: 0 in 0.087s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] <== create_volume: return (470ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:30:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.482s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a694dc-02a7-43db-9efb-b5ed9043a0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c0a511b-509c-47b0-aabd-52662831e46b', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aeae7ed-7745-46e5-a0f4-3398b6357ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:17 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Volume volume-6c0a511b-509c-47b0-aabd-52662831e46b (6c0a511b-509c-47b0-aabd-52662831e46b): created successfully
Sep 18 22:30:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aeae7ed-7745-46e5-a0f4-3398b6357ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Flow 'volume_create_manager' (8d9e071a-8c8c-4db5-9231-8513b6271275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:30:17 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a009713d-4e33-4e22-ac8c-65773bc486ef tempest-VolumesActionsTest-1570088156 None] Created volume successfully.
Sep 18 22:30:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Acquiring lock "cinder-6c0a511b-509c-47b0-aabd-52662831e46b-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:30:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Lock "cinder-6c0a511b-509c-47b0-aabd-52662831e46b-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:30:17 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:30:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Acquiring lock "cinder-quobyte-6c0a511b-509c-47b0-aabd-52662831e46b" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:30:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Lock "cinder-quobyte-6c0a511b-509c-47b0-aabd-52662831e46b" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:30:17 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[438092eb-995c-4879-982d-25e004bdf7bb]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:30:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c0a511b-509c-47b0-aabd-52662831e46b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c0a511b-509c-47b0-aabd-52662831e46b" returned: 0 in 0.408s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c0a511b-509c-47b0-aabd-52662831e46b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c0a511b-509c-47b0-aabd-52662831e46b" returned: 0 in 0.094s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:18 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Lock "cinder-quobyte-6c0a511b-509c-47b0-aabd-52662831e46b" released by "delete_volume" :: held 0.671s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:30:18 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Created reservations ['2eeb66d9-f71d-48f5-ac87-8c80bbae166a', 'b4e7f913-38c0-49d3-85d3-ff155d2763ca', '663df838-4c4b-4449-9870-9120f52345bc', 'a8c8056f-57e9-4d73-ac77-1f4d13e656c6'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:30:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:30:19 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:30:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.089s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:19 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:30:19 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Deleted volume successfully.
Sep 18 22:30:19 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fee94707-308a-446d-b862-cf2fda72d7a0 tempest-VolumesActionsTest-2078200964 None] Lock "cinder-6c0a511b-509c-47b0-aabd-52662831e46b-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:30:20 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Flow 'volume_create_manager' (c96079e4-9642-4935-ac03-7964f87e3367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40628ddf-f667-44cd-b56e-67689caacf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40628ddf-f667-44cd-b56e-67689caacf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-916639571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faaf9fb8-f23d-43b2-a796-9e5b26783312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f281853a4e4be688f8d03f8cc8be5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:30:20Z,use_quota=True,user_id='482b4d70488746f5afbf99e8829164c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08851201-7cad-4c89-97ed-4fe0c94c664f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08851201-7cad-4c89-97ed-4fe0c94c664f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e515d33d-c4c4-4c6a-85e6-d82d0d2da92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e515d33d-c4c4-4c6a-85e6-d82d0d2da92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faaf9fb8-f23d-43b2-a796-9e5b26783312', 'volume_name': 'volume-faaf9fb8-f23d-43b2-a796-9e5b26783312', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060147dc-0e8d-44fc-8464-f8751909169e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060147dc-0e8d-44fc-8464-f8751909169e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1774b2-bcab-42c9-bfad-eb4e605d6479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:20 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Volume faaf9fb8-f23d-43b2-a796-9e5b26783312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faaf9fb8-f23d-43b2-a796-9e5b26783312', 'volume_size': 1}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-916639571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faaf9fb8-f23d-43b2-a796-9e5b26783312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f281853a4e4be688f8d03f8cc8be5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:30:20Z,use_quota=True,user_id='482b4d70488746f5afbf99e8829164c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Creating volume faaf9fb8-f23d-43b2-a796-9e5b26783312 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:30:20 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-faaf9fb8-f23d-43b2-a796-9e5b26783312 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:20 devstack quobyte-client[83360]: System call of process 97957 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:30:20 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=121, name=volume-faaf9fb8-f23d-43b2-a796-9e5b26783312, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-faaf9fb8-f23d-43b2-a796-9e5b26783312 1073741824" returned: 0 in 0.316s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-faaf9fb8-f23d-43b2-a796-9e5b26783312 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-faaf9fb8-f23d-43b2-a796-9e5b26783312" returned: 0 in 0.085s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] <== create_volume: return (468ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:30:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.480s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c1774b2-bcab-42c9-bfad-eb4e605d6479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faaf9fb8-f23d-43b2-a796-9e5b26783312', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f876322-40c8-4c8b-ac0d-05cb6d94c774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:21 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Volume volume-faaf9fb8-f23d-43b2-a796-9e5b26783312 (faaf9fb8-f23d-43b2-a796-9e5b26783312): created successfully
Sep 18 22:30:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f876322-40c8-4c8b-ac0d-05cb6d94c774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:21 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Flow 'volume_create_manager' (c96079e4-9642-4935-ac03-7964f87e3367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:30:21 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-b0dd3f07-33cf-4c2f-a159-98120b51e1a1 tempest-VolumesActionsTest-1570088156 None] Created volume successfully.
Sep 18 22:30:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Acquiring lock "cinder-faaf9fb8-f23d-43b2-a796-9e5b26783312-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:30:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Lock "cinder-faaf9fb8-f23d-43b2-a796-9e5b26783312-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:30:23 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:30:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Acquiring lock "cinder-quobyte-faaf9fb8-f23d-43b2-a796-9e5b26783312" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:30:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Lock "cinder-quobyte-faaf9fb8-f23d-43b2-a796-9e5b26783312" acquired by "delete_volume" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:30:23 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b78a982-67ac-4faa-91d5-fb81e5ccb1c5]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:30:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-faaf9fb8-f23d-43b2-a796-9e5b26783312 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-faaf9fb8-f23d-43b2-a796-9e5b26783312" returned: 0 in 0.403s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-faaf9fb8-f23d-43b2-a796-9e5b26783312 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-faaf9fb8-f23d-43b2-a796-9e5b26783312" returned: 0 in 0.101s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Lock "cinder-quobyte-faaf9fb8-f23d-43b2-a796-9e5b26783312" released by "delete_volume" :: held 0.669s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:30:24 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Created reservations ['cf5d3b82-8d08-4ea0-8ab8-61242eba5685', '0d1b3900-479d-487c-9c00-5fda2b26e8e6', '7207a199-eef2-4018-883f-a6f7555f5204', '0c8c1af4-6069-47f0-8d91-91c719ec6d30'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:30:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:30:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:30:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.087s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:24 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:30:24 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Deleted volume successfully.
Sep 18 22:30:24 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b16fbe70-1db3-4834-961c-44f8ad4647cb tempest-VolumesActionsTest-1570088156 None] Lock "cinder-faaf9fb8-f23d-43b2-a796-9e5b26783312-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:30:34 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=31,cinder:UPDATE=47,cinder:DELETE=4,cinder:INSERT=5 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:30:34 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=53,cinder:SELECT=29,cinder:INSERT=15,cinder:DELETE=6 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:30:40 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:30:40 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:30:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Flow 'volume_create_manager' (ac2a2925-806b-407b-a432-7c95fdc7ee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:30:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16848ae-4c90-495a-8358-b452973561f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16848ae-4c90-495a-8358-b452973561f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-353296504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78493925-bda6-4b9b-9bdc-7305dbc137bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180bae870ff545fbb9f90627164a094e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:30:40Z,use_quota=True,user_id='3abbfab5cb4443fbab6454925f7427cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19bf1e88-c6e8-4cdd-b2f2-5b1e68702a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19bf1e88-c6e8-4cdd-b2f2-5b1e68702a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2802ee-70b0-4ae8-92b6-529e5af27d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2802ee-70b0-4ae8-92b6-529e5af27d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '78493925-bda6-4b9b-9bdc-7305dbc137bf', 'volume_name': 'volume-78493925-bda6-4b9b-9bdc-7305dbc137bf', 'volume_size': 1, 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b51f48f363a84a708334255554fa3921', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'created_at': datetime.datetime(2025, 9, 18, 19, 51, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 19, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e9f9b45e-88d0-41ad-b728-fb173316839e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f905e97a5f0>}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e16498-0cab-4627-94a4-21725054a826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e16498-0cab-4627-94a4-21725054a826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123a4747-4e8b-4f65-b01e-833a2c72906d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:40 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Volume 78493925-bda6-4b9b-9bdc-7305dbc137bf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-78493925-bda6-4b9b-9bdc-7305dbc137bf', 'volume_size': 1, 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b51f48f363a84a708334255554fa3921', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'created_at': datetime.datetime(2025, 9, 18, 19, 51, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 19, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e9f9b45e-88d0-41ad-b728-fb173316839e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f905e97a5f0>}
Sep 18 22:30:40 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Cloning 78493925-bda6-4b9b-9bdc-7305dbc137bf from image e9f9b45e-88d0-41ad-b728-fb173316839e  at location (None, None). {{(pid=83342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 18 22:30:40 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_74kc_3e9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 22:30:40 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Image download 20.69 MB at 20.69 MB/s
Sep 18 22:30:40 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a422b65-83ca-47f9-907b-e2918ad435b5]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:30:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_74kc_3e9devstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:41 devstack sudo[98011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_74kc_3e9devstack@QuobyteHD
Sep 18 22:30:41 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:30:42 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root
Sep 18 22:30:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_74kc_3e9devstack@QuobyteHD" returned: 0 in 1.931s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:42 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Temporary image e9f9b45e-88d0-41ad-b728-fb173316839e is fetched for user 3abbfab5cb4443fbab6454925f7427cd. {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 22:30:42 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5166081e-d939-4036-9711-a0f5082989d6]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:30:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_74kc_3e9devstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:43 devstack sudo[98017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_74kc_3e9devstack@QuobyteHD
Sep 18 22:30:43 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:30:44 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root
Sep 18 22:30:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_74kc_3e9devstack@QuobyteHD" returned: 0 in 1.917s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-353296504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78493925-bda6-4b9b-9bdc-7305dbc137bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='180bae870ff545fbb9f90627164a094e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:30:40Z,use_quota=True,user_id='3abbfab5cb4443fbab6454925f7427cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:30:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Creating volume 78493925-bda6-4b9b-9bdc-7305dbc137bf {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:30:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:30:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:30:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:30:44 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:30:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:45 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=122, name=volume-78493925-bda6-4b9b-9bdc-7305dbc137bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:30:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf 1073741824" returned: 0 in 0.323s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf" returned: 0 in 0.087s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] <== create_volume: return (504ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:30:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.540s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:45 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Attempting download of e9f9b45e-88d0-41ad-b728-fb173316839e ((None, None)) to volume 78493925-bda6-4b9b-9bdc-7305dbc137bf. {{(pid=83342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 22:30:45 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeea59a2-f631-48d2-a3a3-9a99158859b0]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:30:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_b_stxuu7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_b_stxuu7" returned: 0 in 0.339s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_b_stxuu7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_b_stxuu7" returned: 1 in 0.353s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e9f9b45e-88d0-41ad-b728-fb173316839e_b_stxuu7' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:30:46 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a3aa18-7f60-43a4-90a8-80de66f3b588]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:30:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_74kc_3e9devstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_74kc_3e9devstack@QuobyteHD" returned: 0 in 0.331s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:30:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:30:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:30:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:47 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] e9f9b45e-88d0-41ad-b728-fb173316839e was qcow2, converting to raw {{(pid=83342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 22:30:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_74kc_3e9devstack@QuobyteHD /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.187s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:30:47 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=122, name=volume-78493925-bda6-4b9b-9bdc-7305dbc137bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:30:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_74kc_3e9devstack@QuobyteHD /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf" returned: 0 in 1.030s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:48 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e9f9b45e-88d0-41ad-b728-fb173316839e_74kc_3e9devstack@QuobyteHD, size 112.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf {{(pid=83342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 22:30:48 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Converted 112.00 MB image at 107.53 MB/s
Sep 18 22:30:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf 1G" returned: 0 in 0.130s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:48 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f4fb54-2370-4c7d-81f3-098bbfd0cc30]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:30:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf" returned: 0 in 0.366s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf" returned: 1 in 0.373s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:30:49 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Downloaded image e9f9b45e-88d0-41ad-b728-fb173316839e ((None, None)) to volume 78493925-bda6-4b9b-9bdc-7305dbc137bf successfully. {{(pid=83342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 22:30:49 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Temporary image e9f9b45e-88d0-41ad-b728-fb173316839e for user 3abbfab5cb4443fbab6454925f7427cd is deleted. {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 22:30:49 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Marking volume 78493925-bda6-4b9b-9bdc-7305dbc137bf as bootable. {{(pid=83342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 22:30:49 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Copying metadata from image e9f9b45e-88d0-41ad-b728-fb173316839e to 78493925-bda6-4b9b-9bdc-7305dbc137bf. {{(pid=83342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 22:30:49 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Creating volume glance metadata for volume 78493925-bda6-4b9b-9bdc-7305dbc137bf backed by image e9f9b45e-88d0-41ad-b728-fb173316839e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 22:30:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123a4747-4e8b-4f65-b01e-833a2c72906d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78493925-bda6-4b9b-9bdc-7305dbc137bf', 'volume_size': 1, 'image_id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b51f48f363a84a708334255554fa3921', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e9f9b45e-88d0-41ad-b728-fb173316839e', 'created_at': datetime.datetime(2025, 9, 18, 19, 51, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 19, 51, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e9f9b45e-88d0-41ad-b728-fb173316839e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f905e97a5f0>}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833073b3-4c0d-4b88-8abf-41ee125b3254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:49 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Volume volume-78493925-bda6-4b9b-9bdc-7305dbc137bf (78493925-bda6-4b9b-9bdc-7305dbc137bf): created successfully
Sep 18 22:30:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833073b3-4c0d-4b88-8abf-41ee125b3254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Flow 'volume_create_manager' (ac2a2925-806b-407b-a432-7c95fdc7ee14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:30:49 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-5a495077-fb0a-44f9-bc34-5728e3664e19 tempest-VolumesImageMetadata-1668149039 None] Created volume successfully.
Sep 18 22:30:51 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Acquiring lock "cinder-78493925-bda6-4b9b-9bdc-7305dbc137bf-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:30:51 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Lock "cinder-78493925-bda6-4b9b-9bdc-7305dbc137bf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:30:51 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:30:51 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Acquiring lock "cinder-quobyte-78493925-bda6-4b9b-9bdc-7305dbc137bf" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:30:51 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Lock "cinder-quobyte-78493925-bda6-4b9b-9bdc-7305dbc137bf" acquired by "delete_volume" :: waited 0.010s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:30:51 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3522e4-6ba0-4067-853f-bbcf03b542ad]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:30:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf" returned: 0 in 0.363s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf" returned: 1 in 0.351s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:30:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-78493925-bda6-4b9b-9bdc-7305dbc137bf" returned: 0 in 0.092s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Lock "cinder-quobyte-78493925-bda6-4b9b-9bdc-7305dbc137bf" released by "delete_volume" :: held 1.036s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:30:52 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Created reservations ['e33dc71a-a80c-4ebe-8647-73874f7b9f18', 'f348abc6-f61f-43d8-9be1-c86fcf233d94', 'e23f07fb-eece-488a-be08-7dfcb98a1990', '6bf54bf3-c40b-4253-8015-c2763e93cbe7'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:30:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:30:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:30:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.087s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:52 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:30:52 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Deleted volume successfully.
Sep 18 22:30:53 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fd5e3751-6c2b-4c8b-a2ce-121a6bff9d9d tempest-VolumesImageMetadata-1668149039 None] Lock "cinder-78493925-bda6-4b9b-9bdc-7305dbc137bf-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:30:55 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:30:55 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Flow 'volume_create_manager' (f0bc5acf-8e15-41fa-83a0-1571c7e34a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cd674e-7d09-474a-91a0-e3977c02f9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cd674e-7d09-474a-91a0-e3977c02f9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-788840845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce417f4-6d38-4d7a-b632-f235d2703cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8362a491f3b34adbaf1cfeff2bbb720d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:30:56Z,use_quota=True,user_id='92e414140807459fb18df552d1d72bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee31720-6427-479b-9576-95f1bfd20174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fee31720-6427-479b-9576-95f1bfd20174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43cfa325-de0f-4d97-bf40-5e624dabff21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43cfa325-de0f-4d97-bf40-5e624dabff21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce417f4-6d38-4d7a-b632-f235d2703cb1', 'volume_name': 'volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5104bf-a2fe-421f-bdcd-c0495c95583d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5104bf-a2fe-421f-bdcd-c0495c95583d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00ce7c8-dbc9-4623-b98f-aef599d471de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:56 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Volume 4ce417f4-6d38-4d7a-b632-f235d2703cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1', 'volume_size': 1}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-788840845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce417f4-6d38-4d7a-b632-f235d2703cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8362a491f3b34adbaf1cfeff2bbb720d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:30:56Z,use_quota=True,user_id='92e414140807459fb18df552d1d72bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Creating volume 4ce417f4-6d38-4d7a-b632-f235d2703cb1 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:30:56 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:56 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=123, name=volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1 1073741824" returned: 0 in 0.328s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1" returned: 0 in 0.084s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] <== create_volume: return (484ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.497s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00ce7c8-dbc9-4623-b98f-aef599d471de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486a7de3-f0bd-4461-a249-6b08770d8868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:30:56 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Volume volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1 (4ce417f4-6d38-4d7a-b632-f235d2703cb1): created successfully
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486a7de3-f0bd-4461-a249-6b08770d8868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:30:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Flow 'volume_create_manager' (f0bc5acf-8e15-41fa-83a0-1571c7e34a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:30:56 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-8dbb5dd7-e651-4a58-a368-28413540d0fe tempest-SnapshotMetadataTestJSON-1435730694 None] Created volume successfully.
Sep 18 22:30:58 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:30:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:30:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:30:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] Creating offline snapshot f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6 of volume 4ce417f4-6d38-4d7a-b632-f235d2703cb1 {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:30:58 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a22b95-3c5a-412c-abe8-2769e2cbcb30]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:30:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1" returned: 0 in 0.422s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:59 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=124, name=volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:30:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6 1G" returned: 0 in 0.237s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:59 devstack quobyte-client[83360]: System call of process 98068 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:30:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "qemu-img rebase -u -b volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6" returned: 0 in 0.152s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:30:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6" returned: 0 in 0.118s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:30:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6" returned: 0 in 0.091s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.info" returned: 0 in 0.089s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:30:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:30:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.info" returned: 0 in 0.083s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:30:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.570s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:31:00 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-3cf48ce5-b011-4c1f-8c44-f44b89d42b3f tempest-SnapshotMetadataTestJSON-1435730694 None] Create snapshot completed successfully
Sep 18 22:31:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Acquiring lock "cinder-f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:31:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "cinder-f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:31:01 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:31:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Acquiring lock "cinder-quobyte-4ce417f4-6d38-4d7a-b632-f235d2703cb1" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:31:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "cinder-quobyte-4ce417f4-6d38-4d7a-b632-f235d2703cb1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:31:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Acquiring lock "cinder-quobyte-f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:31:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "cinder-quobyte-f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:31:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Deleting offline snapshot f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6 of volume 4ce417f4-6d38-4d7a-b632-f235d2703cb1 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:31:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] snapshot_file for this snap is: volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:31:01 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5480c8-2fdf-4bf0-9db8-002abf6e1327]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:31:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6" returned: 0 in 0.382s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:31:01 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afe145d-59f5-474a-ab3a-e408e3a51fb7]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:31:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1" returned: 0 in 0.401s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6" returned: 0 in 0.205s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1.f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6" returned: 0 in 0.093s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:02 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "cinder-quobyte-f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6" released by "_delete_snapshot" :: held 1.403s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:31:02 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "cinder-quobyte-4ce417f4-6d38-4d7a-b632-f235d2703cb1" released by "delete_snapshot" :: held 1.427s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:31:03 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Created reservations ['d2bb211c-dc27-4cc1-979f-b8e9c21aa56f', '5a91bbe2-df05-4669-a3f0-1ba630d8b2eb', 'b745bcde-3281-4839-974c-b7e04601fc71', '099232d1-d081-43bc-9a43-0be4e55b9376'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:31:03 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Delete snapshot completed successfully.
Sep 18 22:31:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-95e5bcb8-702d-421a-a5bf-28b335d3d7d2 tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "cinder-f4d27bdc-f2a4-4460-bdeb-b1afb3af68b6-delete_snapshot" released by "delete_snapshot" :: held 1.893s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:31:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Acquiring lock "cinder-4ce417f4-6d38-4d7a-b632-f235d2703cb1-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:31:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "cinder-4ce417f4-6d38-4d7a-b632-f235d2703cb1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:31:03 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:31:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Acquiring lock "cinder-quobyte-4ce417f4-6d38-4d7a-b632-f235d2703cb1" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:31:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "cinder-quobyte-4ce417f4-6d38-4d7a-b632-f235d2703cb1" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:31:03 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[003f53ef-1069-454f-a6f1-3cdd85aeea13]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:31:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1" returned: 0 in 0.405s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ce417f4-6d38-4d7a-b632-f235d2703cb1" returned: 0 in 0.111s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "cinder-quobyte-4ce417f4-6d38-4d7a-b632-f235d2703cb1" released by "delete_volume" :: held 0.693s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:31:04 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Created reservations ['3ea2d138-bd96-4d4a-8977-a7733eb9dd3d', '307e7b8a-79e4-4f17-94c0-2ed4e58cd6f7', '85c8785c-5c1e-4578-9dfd-aec7320a0798', '0c5ca689-914e-4763-914c-17963c3cc97e'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:31:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:31:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:31:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:31:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:31:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:31:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.086s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:04 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:31:04 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Deleted volume successfully.
Sep 18 22:31:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d7ff2eeb-f2d5-4692-b4f8-7156eca9bce0 tempest-SnapshotMetadataTestJSON-1435730694 None] Lock "cinder-4ce417f4-6d38-4d7a-b632-f235d2703cb1-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:31:08 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Flow 'volume_create_manager' (4e00d0f3-fd71-4a6c-a65b-ce0e5ddd059b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d2f844-5606-4b81-9ce8-9bd6d50325fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d2f844-5606-4b81-9ce8-9bd6d50325fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1477042624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5dae65-d806-4bf5-a88e-50edecb34a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e99869f26d48fbbc8a811c45e3499d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:31:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:31:08Z,use_quota=True,user_id='866ad5195aa4492197f9ac208958001f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabffb2a-2beb-4605-9c51-ff6d09782318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabffb2a-2beb-4605-9c51-ff6d09782318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa1988f-40bf-4a03-a0f1-65b8328abea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa1988f-40bf-4a03-a0f1-65b8328abea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5dae65-d806-4bf5-a88e-50edecb34a27', 'volume_name': 'volume-ef5dae65-d806-4bf5-a88e-50edecb34a27', 'volume_size': 2}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745b188a-60c0-4f8c-9399-9d4cf60abfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (745b188a-60c0-4f8c-9399-9d4cf60abfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6abe6c0-caf0-4057-b13d-ac23d95b34ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:31:08 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Volume ef5dae65-d806-4bf5-a88e-50edecb34a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5dae65-d806-4bf5-a88e-50edecb34a27', 'volume_size': 2}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1477042624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5dae65-d806-4bf5-a88e-50edecb34a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e99869f26d48fbbc8a811c45e3499d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:31:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:31:08Z,use_quota=True,user_id='866ad5195aa4492197f9ac208958001f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Creating volume ef5dae65-d806-4bf5-a88e-50edecb34a27 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:31:08 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ef5dae65-d806-4bf5-a88e-50edecb34a27 2147483648 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:08 devstack quobyte-client[83360]: System call of process 98093 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:31:08 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=126, name=volume-ef5dae65-d806-4bf5-a88e-50edecb34a27, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ef5dae65-d806-4bf5-a88e-50edecb34a27 2147483648" returned: 0 in 0.442s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ef5dae65-d806-4bf5-a88e-50edecb34a27 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ef5dae65-d806-4bf5-a88e-50edecb34a27" returned: 0 in 0.133s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] <== create_volume: return (637ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:31:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.649s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:31:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6abe6c0-caf0-4057-b13d-ac23d95b34ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5dae65-d806-4bf5-a88e-50edecb34a27', 'volume_size': 2}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:31:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc2cb75-40de-44d4-a7ba-68f4728d495b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:31:09 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Volume volume-ef5dae65-d806-4bf5-a88e-50edecb34a27 (ef5dae65-d806-4bf5-a88e-50edecb34a27): created successfully
Sep 18 22:31:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc2cb75-40de-44d4-a7ba-68f4728d495b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:31:09 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Flow 'volume_create_manager' (4e00d0f3-fd71-4a6c-a65b-ce0e5ddd059b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:31:09 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-d11e92e1-e8d2-4042-b1d4-6ea983eb86b8 tempest-VolumesCloneNegativeTest-1815468703 None] Created volume successfully.
Sep 18 22:31:10 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Acquiring lock "cinder-ef5dae65-d806-4bf5-a88e-50edecb34a27-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:31:10 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Lock "cinder-ef5dae65-d806-4bf5-a88e-50edecb34a27-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:31:10 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:31:10 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Acquiring lock "cinder-quobyte-ef5dae65-d806-4bf5-a88e-50edecb34a27" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:31:10 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Lock "cinder-quobyte-ef5dae65-d806-4bf5-a88e-50edecb34a27" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:31:10 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2efb8a-5dfb-4aac-a7e7-d715c289b780]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:31:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ef5dae65-d806-4bf5-a88e-50edecb34a27 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:10 devstack quobyte-client[83360]: System call of process 98098 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:31:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ef5dae65-d806-4bf5-a88e-50edecb34a27" returned: 0 in 0.403s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ef5dae65-d806-4bf5-a88e-50edecb34a27 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ef5dae65-d806-4bf5-a88e-50edecb34a27" returned: 0 in 0.102s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Lock "cinder-quobyte-ef5dae65-d806-4bf5-a88e-50edecb34a27" released by "delete_volume" :: held 0.653s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:31:11 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Created reservations ['f94353bd-da31-4cb4-8241-349770af9766', 'f9968da8-eefd-4273-9b0b-0c1974791531', 'aff4584f-6c9b-4642-996e-b5810a42274c', '48f97cf8-c441-49c6-a219-1f38937ddd35'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:31:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:31:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:31:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:31:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:31:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:31:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.106s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:11 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:31:11 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Deleted volume successfully.
Sep 18 22:31:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-4510c3ba-79a1-4649-8bd3-393e69d3910a tempest-VolumesCloneNegativeTest-1815468703 None] Lock "cinder-ef5dae65-d806-4bf5-a88e-50edecb34a27-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:31:15 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:31:15 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:31:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Flow 'volume_create_manager' (fcfd52ed-7040-4e7e-8f94-41cdb0be0971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:31:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a08604-12ba-462f-9f04-4ba381c46ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:31:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a08604-12ba-462f-9f04-4ba381c46ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-763529548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81b378e-9871-4bf1-9b8f-84f89bbdaee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f842c6b9a834bf2a7ae67aac587b4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:31:16Z,use_quota=True,user_id='449077cf3864461f99d2196653cd1dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a802a9b-fc2c-4f9c-86f9-5250b3137f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a802a9b-fc2c-4f9c-86f9-5250b3137f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fadf852-1532-4107-89f8-e70d04dc2df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fadf852-1532-4107-89f8-e70d04dc2df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f81b378e-9871-4bf1-9b8f-84f89bbdaee8', 'volume_name': 'volume-f81b378e-9871-4bf1-9b8f-84f89bbdaee8', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafe73ae-45b9-4f7c-b46f-c15c978c6ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bafe73ae-45b9-4f7c-b46f-c15c978c6ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5b365b-292c-431d-98c4-680aaf8fcbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:31:16 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Volume f81b378e-9871-4bf1-9b8f-84f89bbdaee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f81b378e-9871-4bf1-9b8f-84f89bbdaee8', 'volume_size': 1}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-763529548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f81b378e-9871-4bf1-9b8f-84f89bbdaee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f842c6b9a834bf2a7ae67aac587b4b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:31:16Z,use_quota=True,user_id='449077cf3864461f99d2196653cd1dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Creating volume f81b378e-9871-4bf1-9b8f-84f89bbdaee8 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:31:16 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f81b378e-9871-4bf1-9b8f-84f89bbdaee8 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:16 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=127, name=volume-f81b378e-9871-4bf1-9b8f-84f89bbdaee8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f81b378e-9871-4bf1-9b8f-84f89bbdaee8 1073741824" returned: 0 in 0.313s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f81b378e-9871-4bf1-9b8f-84f89bbdaee8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f81b378e-9871-4bf1-9b8f-84f89bbdaee8" returned: 0 in 0.084s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] <== create_volume: return (465ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.478s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5b365b-292c-431d-98c4-680aaf8fcbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f81b378e-9871-4bf1-9b8f-84f89bbdaee8', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6a8e39-7a7f-4f3b-815a-db150c43721c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:31:16 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Volume volume-f81b378e-9871-4bf1-9b8f-84f89bbdaee8 (f81b378e-9871-4bf1-9b8f-84f89bbdaee8): created successfully
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6a8e39-7a7f-4f3b-815a-db150c43721c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:31:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Flow 'volume_create_manager' (fcfd52ed-7040-4e7e-8f94-41cdb0be0971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:31:16 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-b3f704c8-81fe-40a7-aa57-84e2dfcdce06 tempest-VolumesNegativeTest-1636342631 None] Created volume successfully.
Sep 18 22:31:35 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=42,cinder:SELECT=30,cinder:INSERT=17,cinder:DELETE=4 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:31:35 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=36,cinder:INSERT=12,cinder:UPDATE=39,cinder:DELETE=4 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:31:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:31:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:31:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:31:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:31:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:31:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:31:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.090s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:31:55 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Acquiring lock "cinder-f81b378e-9871-4bf1-9b8f-84f89bbdaee8-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:31:55 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Lock "cinder-f81b378e-9871-4bf1-9b8f-84f89bbdaee8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:31:55 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:31:55 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Acquiring lock "cinder-quobyte-f81b378e-9871-4bf1-9b8f-84f89bbdaee8" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:31:55 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Lock "cinder-quobyte-f81b378e-9871-4bf1-9b8f-84f89bbdaee8" acquired by "delete_volume" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:31:55 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[19503e64-0fe2-4a74-a2a0-dc3cd54ba88b]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:31:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f81b378e-9871-4bf1-9b8f-84f89bbdaee8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f81b378e-9871-4bf1-9b8f-84f89bbdaee8" returned: 0 in 0.394s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f81b378e-9871-4bf1-9b8f-84f89bbdaee8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-f81b378e-9871-4bf1-9b8f-84f89bbdaee8" returned: 0 in 0.107s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:56 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Lock "cinder-quobyte-f81b378e-9871-4bf1-9b8f-84f89bbdaee8" released by "delete_volume" :: held 0.650s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:31:56 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Created reservations ['830d1fc2-7db4-419a-9ec9-475da5c5264d', 'd6b5d5c8-3124-4388-a671-fbb9f64c3716', '7797949d-c4fa-4f93-b588-6e1fc696c43f', '0b58b799-30cd-416e-91d1-abc534a5b0bf'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:31:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:31:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:31:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:31:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:31:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:31:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:31:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.109s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:31:57 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:31:57 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Deleted volume successfully.
Sep 18 22:31:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b44daf4-975a-4585-b0a1-7461db1b52e2 tempest-VolumesNegativeTest-1636342631 None] Lock "cinder-f81b378e-9871-4bf1-9b8f-84f89bbdaee8-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:32:06 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:32:07 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:32:45 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Flow 'volume_create_manager' (3ec3b4d6-04d8-4fd0-a4d4-e0427e47957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f18d2e-0f7e-47c6-933a-3d1d8038d43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9f18d2e-0f7e-47c6-933a-3d1d8038d43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1688922729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b578ae-641e-4b12-b697-b5d3808f15d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eabbb0ce4d2841c49f6b6b5d3fa8266e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:32:45Z,use_quota=True,user_id='853bd064d2e94eaca01d251c47121b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f254a5b6-5e54-4cc4-946f-364eac50d07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f254a5b6-5e54-4cc4-946f-364eac50d07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7925c93-c90e-40dc-b139-a694f8078917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7925c93-c90e-40dc-b139-a694f8078917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b578ae-641e-4b12-b697-b5d3808f15d9', 'volume_name': 'volume-b2b578ae-641e-4b12-b697-b5d3808f15d9', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0afaea-6500-4d82-87e5-6130cee8a6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0afaea-6500-4d82-87e5-6130cee8a6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d214c1c4-c9c9-41c0-9830-0f35e015c63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:32:45 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Volume b2b578ae-641e-4b12-b697-b5d3808f15d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b578ae-641e-4b12-b697-b5d3808f15d9', 'volume_size': 1}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1688922729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b578ae-641e-4b12-b697-b5d3808f15d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eabbb0ce4d2841c49f6b6b5d3fa8266e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:32:45Z,use_quota=True,user_id='853bd064d2e94eaca01d251c47121b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Creating volume b2b578ae-641e-4b12-b697-b5d3808f15d9 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:32:45 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b2b578ae-641e-4b12-b697-b5d3808f15d9 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:32:45 devstack quobyte-client[83360]: System call of process 98458 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:32:45 devstack quobyte-client[83360]: System call of process 98458 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:32:45 devstack quobyte-client[83360]: System call of process 98458 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:32:45 devstack quobyte-client[83360]: System call of process 98458 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:32:45 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=128, name=volume-b2b578ae-641e-4b12-b697-b5d3808f15d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b2b578ae-641e-4b12-b697-b5d3808f15d9 1073741824" returned: 0 in 0.401s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b2b578ae-641e-4b12-b697-b5d3808f15d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b2b578ae-641e-4b12-b697-b5d3808f15d9" returned: 0 in 0.092s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] <== create_volume: return (562ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:32:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.573s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:32:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d214c1c4-c9c9-41c0-9830-0f35e015c63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b578ae-641e-4b12-b697-b5d3808f15d9', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:32:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e5fc95-011f-4d6d-83a2-1a9de24297bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:32:46 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Volume volume-b2b578ae-641e-4b12-b697-b5d3808f15d9 (b2b578ae-641e-4b12-b697-b5d3808f15d9): created successfully
Sep 18 22:32:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e5fc95-011f-4d6d-83a2-1a9de24297bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:32:46 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Flow 'volume_create_manager' (3ec3b4d6-04d8-4fd0-a4d4-e0427e47957f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:32:46 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-46ff319f-c478-47b5-85d9-782490b13215 tempest-TestMinimumBasicScenario-365596273 None] Created volume successfully.
Sep 18 22:32:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:32:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:32:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:32:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:32:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:32:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:32:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:32:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.099s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:32:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:32:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-26ff0bfe-87fb-496e-b3d5-92740a6025ff req-b9e0b519-2c81-47e7-af21-4a7a4b696a30 tempest-TestMinimumBasicScenario-365596273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:32:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-26ff0bfe-87fb-496e-b3d5-92740a6025ff req-b9e0b519-2c81-47e7-af21-4a7a4b696a30 tempest-TestMinimumBasicScenario-365596273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:32:51 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee2124d-496b-4061-be99-20bec7664055]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:32:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-26ff0bfe-87fb-496e-b3d5-92740a6025ff req-b9e0b519-2c81-47e7-af21-4a7a4b696a30 tempest-TestMinimumBasicScenario-365596273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b2b578ae-641e-4b12-b697-b5d3808f15d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:32:51 devstack quobyte-client[83360]: System call of process 98471 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:32:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [req-26ff0bfe-87fb-496e-b3d5-92740a6025ff req-b9e0b519-2c81-47e7-af21-4a7a4b696a30 tempest-TestMinimumBasicScenario-365596273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b2b578ae-641e-4b12-b697-b5d3808f15d9" returned: 0 in 0.471s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:32:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [req-26ff0bfe-87fb-496e-b3d5-92740a6025ff req-b9e0b519-2c81-47e7-af21-4a7a4b696a30 tempest-TestMinimumBasicScenario-365596273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.532s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:32:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-26ff0bfe-87fb-496e-b3d5-92740a6025ff req-b9e0b519-2c81-47e7-af21-4a7a4b696a30 tempest-TestMinimumBasicScenario-365596273 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e', 'name': 'volume-b2b578ae-641e-4b12-b697-b5d3808f15d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b39c42e0-6607-44f1-ad5f-b8302556acb8', 'enforce_multipath': True} {{(pid=83342) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 18 22:32:52 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-26ff0bfe-87fb-496e-b3d5-92740a6025ff req-b9e0b519-2c81-47e7-af21-4a7a4b696a30 tempest-TestMinimumBasicScenario-365596273 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:32:52 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-26ff0bfe-87fb-496e-b3d5-92740a6025ff req-b9e0b519-2c81-47e7-af21-4a7a4b696a30 tempest-TestMinimumBasicScenario-365596273 None] attachment_update completed successfully.
Sep 18 22:33:02 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:33:02 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=4,cinder:SELECT=6 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:33:35 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:33:35 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:33:46 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:33:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:33:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:33:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:33:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:33:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:33:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:33:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.156s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:33:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:34:47 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:34:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:34:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:34:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:34:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:34:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:34:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:34:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.087s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:34:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:35:26 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-50bdc8fc-54d1-48cb-ac7d-8ee2f3b31824 req-64aa12df-b3cb-4f20-b55d-7d8522f0005a tempest-TestMinimumBasicScenario-365596273 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:35:26 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [req-50bdc8fc-54d1-48cb-ac7d-8ee2f3b31824 req-64aa12df-b3cb-4f20-b55d-7d8522f0005a tempest-TestMinimumBasicScenario-365596273 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:35:26 devstack cinder-volume[83342]: INFO cinder.volume.manager [req-50bdc8fc-54d1-48cb-ac7d-8ee2f3b31824 req-64aa12df-b3cb-4f20-b55d-7d8522f0005a tempest-TestMinimumBasicScenario-365596273 None] Terminate volume connection completed successfully.
Sep 18 22:35:26 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [req-50bdc8fc-54d1-48cb-ac7d-8ee2f3b31824 req-64aa12df-b3cb-4f20-b55d-7d8522f0005a tempest-TestMinimumBasicScenario-365596273 None] Deleting attachment b39c42e0-6607-44f1-ad5f-b8302556acb8. {{(pid=83342) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 18 22:35:28 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Acquiring lock "cinder-b2b578ae-641e-4b12-b697-b5d3808f15d9-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:35:28 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Lock "cinder-b2b578ae-641e-4b12-b697-b5d3808f15d9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:35:28 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:35:28 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Acquiring lock "cinder-quobyte-b2b578ae-641e-4b12-b697-b5d3808f15d9" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:35:28 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Lock "cinder-quobyte-b2b578ae-641e-4b12-b697-b5d3808f15d9" acquired by "delete_volume" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:35:28 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dc887b-9230-48df-a6a1-991c21fea677]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:35:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b2b578ae-641e-4b12-b697-b5d3808f15d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b2b578ae-641e-4b12-b697-b5d3808f15d9" returned: 0 in 0.414s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b2b578ae-641e-4b12-b697-b5d3808f15d9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-b2b578ae-641e-4b12-b697-b5d3808f15d9" returned: 0 in 0.106s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Lock "cinder-quobyte-b2b578ae-641e-4b12-b697-b5d3808f15d9" released by "delete_volume" :: held 0.673s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:35:29 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Created reservations ['2bddfaec-31c1-4514-b310-da322dcdaad7', '19e650ac-018f-429f-9ec3-9269a1137549', '3fc8831f-4fec-4314-9baf-b421f1350ad1', 'd78f6b66-6126-4683-b087-da5758bdb0d4'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:35:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:35:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:35:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:35:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:35:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:35:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.124s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:29 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:35:29 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Deleted volume successfully.
Sep 18 22:35:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-58914257-ee17-419a-a093-90c78a9a90b2 tempest-TestMinimumBasicScenario-365596273 None] Lock "cinder-b2b578ae-641e-4b12-b697-b5d3808f15d9-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:35:39 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=7,cinder:SELECT=6,cinder:INSERT=2 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:35:39 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:35:47 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:35:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:35:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:35:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:35:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:35:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:35:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.094s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:35:50 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Flow 'volume_create_manager' (584761d9-c4d8-4725-a87c-0c5fb8f57185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4fd0ac-b473-4c47-866d-2d76354a5bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4fd0ac-b473-4c47-866d-2d76354a5bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-369876837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4514f38d-8bd4-431e-87d7-867aadfcb61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1791c4e0a3784517bc22e0cc6fcdec77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:35:50Z,use_quota=True,user_id='e06e7ca7d8b645b1868ede0918e7ff2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdd48d8-d374-4495-9470-0096e6f7c538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fdd48d8-d374-4495-9470-0096e6f7c538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71b0107-75ed-40a2-9727-39b44f991348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71b0107-75ed-40a2-9727-39b44f991348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4514f38d-8bd4-431e-87d7-867aadfcb61f', 'volume_name': 'volume-4514f38d-8bd4-431e-87d7-867aadfcb61f', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4060abbf-4743-47b0-bb27-3338d3f70f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4060abbf-4743-47b0-bb27-3338d3f70f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8d8a8d-45a2-43c0-bf96-f75fe2c776ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:50 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Volume 4514f38d-8bd4-431e-87d7-867aadfcb61f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4514f38d-8bd4-431e-87d7-867aadfcb61f', 'volume_size': 1}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-369876837',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4514f38d-8bd4-431e-87d7-867aadfcb61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1791c4e0a3784517bc22e0cc6fcdec77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:35:50Z,use_quota=True,user_id='e06e7ca7d8b645b1868ede0918e7ff2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Creating volume 4514f38d-8bd4-431e-87d7-867aadfcb61f {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:35:50 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:35:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4514f38d-8bd4-431e-87d7-867aadfcb61f 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:50 devstack quobyte-client[83360]: System call of process 99340 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:35:51 devstack quobyte-client[83360]: System call of process 99340 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:35:51 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=129, name=volume-4514f38d-8bd4-431e-87d7-867aadfcb61f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:35:51 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Flow 'volume_create_manager' (d532f5e9-e54f-47fc-b01e-9ba594edd498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2097d7b0-adf1-4da4-b2d2-2503c1b5e3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4514f38d-8bd4-431e-87d7-867aadfcb61f 1073741824" returned: 0 in 0.638s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4514f38d-8bd4-431e-87d7-867aadfcb61f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2097d7b0-adf1-4da4-b2d2-2503c1b5e3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-112612020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab86155-fd8b-4db3-b6e7-af63edde68f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1791c4e0a3784517bc22e0cc6fcdec77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:35:51Z,use_quota=True,user_id='e06e7ca7d8b645b1868ede0918e7ff2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed09f52d-a2e6-45f9-8199-718997c8e43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed09f52d-a2e6-45f9-8199-718997c8e43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06cde97-16b4-4ed3-98e4-5f2aacb378bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06cde97-16b4-4ed3-98e4-5f2aacb378bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab86155-fd8b-4db3-b6e7-af63edde68f8', 'volume_name': 'volume-5ab86155-fd8b-4db3-b6e7-af63edde68f8', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba806301-d997-4dc9-b2ad-9b5939019905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba806301-d997-4dc9-b2ad-9b5939019905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1647cd-6475-4394-ad24-c989342d7032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:51 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Volume 5ab86155-fd8b-4db3-b6e7-af63edde68f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab86155-fd8b-4db3-b6e7-af63edde68f8', 'volume_size': 1}
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:35:51 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Flow 'volume_create_manager' (ccaec1ec-a04c-4267-b9ac-f8de7c169470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:35:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72190896-999a-46d9-8f6f-c84f57aa25da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4514f38d-8bd4-431e-87d7-867aadfcb61f" returned: 0 in 0.592s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] <== create_volume: return (1252ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.347s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-112612020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab86155-fd8b-4db3-b6e7-af63edde68f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1791c4e0a3784517bc22e0cc6fcdec77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:35:51Z,use_quota=True,user_id='e06e7ca7d8b645b1868ede0918e7ff2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Creating volume 5ab86155-fd8b-4db3-b6e7-af63edde68f8 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:35:52 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ab86155-fd8b-4db3-b6e7-af63edde68f8 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:52 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=130, name=volume-5ab86155-fd8b-4db3-b6e7-af63edde68f8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72190896-999a-46d9-8f6f-c84f57aa25da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-625588353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2d259d-09af-42c1-b3df-83da8a3b4eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1791c4e0a3784517bc22e0cc6fcdec77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:35:51Z,use_quota=True,user_id='e06e7ca7d8b645b1868ede0918e7ff2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5a41c8-77c1-4031-9d41-08734335dc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5a41c8-77c1-4031-9d41-08734335dc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59390b1a-110d-4bff-b3d2-0d07beb41cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59390b1a-110d-4bff-b3d2-0d07beb41cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e2d259d-09af-42c1-b3df-83da8a3b4eea', 'volume_name': 'volume-6e2d259d-09af-42c1-b3df-83da8a3b4eea', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232f56f5-29f4-43e3-a79b-c710519dbc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232f56f5-29f4-43e3-a79b-c710519dbc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ba976e-6bab-4962-80bf-5c295f5a4689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:52 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Volume 6e2d259d-09af-42c1-b3df-83da8a3b4eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e2d259d-09af-42c1-b3df-83da8a3b4eea', 'volume_size': 1}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:35:52 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Flow 'volume_create_manager' (88fbad57-b0a3-465d-80fc-5fc0faa826b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83462a62-8bd3-41fe-ab50-ce364a65bc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8d8a8d-45a2-43c0-bf96-f75fe2c776ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4514f38d-8bd4-431e-87d7-867aadfcb61f', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9abf355-593e-48a0-8708-011115121c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:52 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Flow 'volume_create_manager' (bbe3d7ba-4b8a-4115-ac2b-51d46dcaadf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de4aa69-3196-43ee-830d-02c24e883238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ab86155-fd8b-4db3-b6e7-af63edde68f8 1073741824" returned: 0 in 0.635s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:52 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Volume volume-4514f38d-8bd4-431e-87d7-867aadfcb61f (4514f38d-8bd4-431e-87d7-867aadfcb61f): created successfully
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9abf355-593e-48a0-8708-011115121c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Flow 'volume_create_manager' (584761d9-c4d8-4725-a87c-0c5fb8f57185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:35:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ab86155-fd8b-4db3-b6e7-af63edde68f8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83462a62-8bd3-41fe-ab50-ce364a65bc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1308251372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976a7535-0aac-4f8b-aa6f-ebd8727a9cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1791c4e0a3784517bc22e0cc6fcdec77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:35:51Z,use_quota=True,user_id='e06e7ca7d8b645b1868ede0918e7ff2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e967e1-d212-4582-9713-50ca33d1c6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51e967e1-d212-4582-9713-50ca33d1c6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea90e00e-0b1f-4b02-89d5-90f2bc72cb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea90e00e-0b1f-4b02-89d5-90f2bc72cb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '976a7535-0aac-4f8b-aa6f-ebd8727a9cf3', 'volume_name': 'volume-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f6600c-8733-408d-888e-b8a0999fe4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f6600c-8733-408d-888e-b8a0999fe4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223dd62f-c1ed-43b1-bd6f-928b183bafcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:53 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Volume 976a7535-0aac-4f8b-aa6f-ebd8727a9cf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3', 'volume_size': 1}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9de4aa69-3196-43ee-830d-02c24e883238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002717484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d10719-fad8-4304-b667-0eb17b16d125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1791c4e0a3784517bc22e0cc6fcdec77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:35:52Z,use_quota=True,user_id='e06e7ca7d8b645b1868ede0918e7ff2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d531dc-3618-4c32-8efa-2a3638290b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d531dc-3618-4c32-8efa-2a3638290b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc98bbfb-9abc-4033-bfc8-58a331a917d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc98bbfb-9abc-4033-bfc8-58a331a917d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5d10719-fad8-4304-b667-0eb17b16d125', 'volume_name': 'volume-d5d10719-fad8-4304-b667-0eb17b16d125', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d189e9fa-fbf9-4a6f-a794-6d72afc7e9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d189e9fa-fbf9-4a6f-a794-6d72afc7e9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08e631b-4b8f-4376-83fb-f8d97b025145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:53 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Volume d5d10719-fad8-4304-b667-0eb17b16d125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5d10719-fad8-4304-b667-0eb17b16d125', 'volume_size': 1}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ab86155-fd8b-4db3-b6e7-af63edde68f8" returned: 0 in 0.418s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:53 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-ddead3dc-ddaf-43e0-9cb8-2264e9418639 tempest-CreateVolumesFromImageTest-1055103443 None] Created volume successfully.
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] <== create_volume: return (1119ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.716s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-625588353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2d259d-09af-42c1-b3df-83da8a3b4eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1791c4e0a3784517bc22e0cc6fcdec77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:35:51Z,use_quota=True,user_id='e06e7ca7d8b645b1868ede0918e7ff2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Creating volume 6e2d259d-09af-42c1-b3df-83da8a3b4eea {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:35:53 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e2d259d-09af-42c1-b3df-83da8a3b4eea 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:53 devstack quobyte-client[83360]: System call of process 99349 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:35:53 devstack quobyte-client[83360]: System call of process 99349 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:35:53 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=131, name=volume-6e2d259d-09af-42c1-b3df-83da8a3b4eea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1647cd-6475-4394-ad24-c989342d7032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab86155-fd8b-4db3-b6e7-af63edde68f8', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecdc544-9f35-48a6-b98a-eccdc0cf7265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:53 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Volume volume-5ab86155-fd8b-4db3-b6e7-af63edde68f8 (5ab86155-fd8b-4db3-b6e7-af63edde68f8): created successfully
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecdc544-9f35-48a6-b98a-eccdc0cf7265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Flow 'volume_create_manager' (d532f5e9-e54f-47fc-b01e-9ba594edd498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e2d259d-09af-42c1-b3df-83da8a3b4eea 1073741824" returned: 0 in 0.447s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e2d259d-09af-42c1-b3df-83da8a3b4eea {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:53 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-974acfc9-a1de-4f1b-85e6-99a1717d8ecd tempest-CreateVolumesFromImageTest-1055103443 None] Created volume successfully.
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e2d259d-09af-42c1-b3df-83da8a3b4eea" returned: 0 in 0.235s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] <== create_volume: return (708ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.862s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1308251372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=976a7535-0aac-4f8b-aa6f-ebd8727a9cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1791c4e0a3784517bc22e0cc6fcdec77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:35:51Z,use_quota=True,user_id='e06e7ca7d8b645b1868ede0918e7ff2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Creating volume 976a7535-0aac-4f8b-aa6f-ebd8727a9cf3 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:35:53 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:35:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:54 devstack quobyte-client[83360]: System call of process 99353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:35:54 devstack quobyte-client[83360]: System call of process 99353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:35:54 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=132, name=volume-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5ba976e-6bab-4962-80bf-5c295f5a4689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e2d259d-09af-42c1-b3df-83da8a3b4eea', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0151c5-416f-4741-b230-a23f174fe69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3 1073741824" returned: 0 in 0.421s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:54 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Volume volume-6e2d259d-09af-42c1-b3df-83da8a3b4eea (6e2d259d-09af-42c1-b3df-83da8a3b4eea): created successfully
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0151c5-416f-4741-b230-a23f174fe69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Flow 'volume_create_manager' (ccaec1ec-a04c-4267-b9ac-f8de7c169470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3" returned: 0 in 0.317s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] <== create_volume: return (768ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.598s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002717484',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d10719-fad8-4304-b667-0eb17b16d125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1791c4e0a3784517bc22e0cc6fcdec77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:35:52Z,use_quota=True,user_id='e06e7ca7d8b645b1868ede0918e7ff2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Creating volume d5d10719-fad8-4304-b667-0eb17b16d125 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:35:54 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:35:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d5d10719-fad8-4304-b667-0eb17b16d125 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:54 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-5c0ad545-c50c-40a0-b5b9-e4cde0b0c664 tempest-CreateVolumesFromImageTest-1055103443 None] Created volume successfully.
Sep 18 22:35:54 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=133, name=volume-d5d10719-fad8-4304-b667-0eb17b16d125, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:35:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223dd62f-c1ed-43b1-bd6f-928b183bafcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063c9f2c-b0f5-4787-87a4-5d61567b291f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:55 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Volume volume-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3 (976a7535-0aac-4f8b-aa6f-ebd8727a9cf3): created successfully
Sep 18 22:35:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063c9f2c-b0f5-4787-87a4-5d61567b291f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Flow 'volume_create_manager' (88fbad57-b0a3-465d-80fc-5fc0faa826b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:35:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d5d10719-fad8-4304-b667-0eb17b16d125 1073741824" returned: 0 in 0.453s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d5d10719-fad8-4304-b667-0eb17b16d125 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:55 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a62687b1-05b7-4ce8-87f8-207365deddda tempest-CreateVolumesFromImageTest-1055103443 None] Created volume successfully.
Sep 18 22:35:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d5d10719-fad8-4304-b667-0eb17b16d125" returned: 0 in 0.296s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:55 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] <== create_volume: return (776ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:35:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:35:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e08e631b-4b8f-4376-83fb-f8d97b025145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5d10719-fad8-4304-b667-0eb17b16d125', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1406c17-439d-4808-be8c-f3968b4a39f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:35:55 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Volume volume-d5d10719-fad8-4304-b667-0eb17b16d125 (d5d10719-fad8-4304-b667-0eb17b16d125): created successfully
Sep 18 22:35:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1406c17-439d-4808-be8c-f3968b4a39f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:35:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Flow 'volume_create_manager' (bbe3d7ba-4b8a-4115-ac2b-51d46dcaadf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:35:55 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a59a78e4-9ac1-4866-8400-318c3cb9c8a0 tempest-CreateVolumesFromImageTest-1055103443 None] Created volume successfully.
Sep 18 22:35:56 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "cinder-d5d10719-fad8-4304-b667-0eb17b16d125-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:35:56 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-d5d10719-fad8-4304-b667-0eb17b16d125-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:35:56 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:35:56 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "cinder-quobyte-d5d10719-fad8-4304-b667-0eb17b16d125" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:35:56 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-quobyte-d5d10719-fad8-4304-b667-0eb17b16d125" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:35:56 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ee65a5-5ed5-4dce-9dce-22e8d501421a]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:35:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d5d10719-fad8-4304-b667-0eb17b16d125 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d5d10719-fad8-4304-b667-0eb17b16d125" returned: 0 in 0.394s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d5d10719-fad8-4304-b667-0eb17b16d125 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d5d10719-fad8-4304-b667-0eb17b16d125" returned: 0 in 0.092s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-quobyte-d5d10719-fad8-4304-b667-0eb17b16d125" released by "delete_volume" :: held 0.660s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:35:57 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Created reservations ['8bd88fef-569a-4b4f-b009-7cf5e4d8ee13', 'fa3df419-11fe-4649-85c6-93851ab73b4e', '3b94af71-077f-4696-9aa0-a2b9aa21ad3e', 'a0ff9e7e-e880-48ae-8997-4a1bb0294223'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:35:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:35:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:35:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:35:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:35:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:35:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.083s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:58 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:35:58 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Deleted volume successfully.
Sep 18 22:35:58 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b671539-80b7-4e77-970a-a533a71891ae tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-d5d10719-fad8-4304-b667-0eb17b16d125-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:35:59 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "cinder-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:35:59 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:35:59 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:35:59 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "cinder-quobyte-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:35:59 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-quobyte-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3" acquired by "delete_volume" :: waited 0.014s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:35:59 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5fc37f-e74d-4785-b445-bd6e5775f5bb]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:35:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3" returned: 0 in 0.391s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:35:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3" returned: 0 in 0.095s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:35:59 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-quobyte-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3" released by "delete_volume" :: held 0.648s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:00 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Created reservations ['f44419c4-617b-4d03-bc86-7d524a74933b', 'cf907137-65f5-49b0-9075-b12cf40a64b1', '81866721-3162-4282-a51b-33b1fd8a2079', '78dc1da9-1de0-425a-8f6b-8dc35bf95018'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:36:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:00 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:00 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.093s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:00 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:36:00 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Deleted volume successfully.
Sep 18 22:36:00 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-e376d4e1-c4a3-41a2-ba3b-2b1103a4fc4d tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-976a7535-0aac-4f8b-aa6f-ebd8727a9cf3-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "cinder-6e2d259d-09af-42c1-b3df-83da8a3b4eea-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-6e2d259d-09af-42c1-b3df-83da8a3b4eea-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:01 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "cinder-quobyte-6e2d259d-09af-42c1-b3df-83da8a3b4eea" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-quobyte-6e2d259d-09af-42c1-b3df-83da8a3b4eea" acquired by "delete_volume" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:01 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2068db-fdec-43b6-bbd2-9a435a072bb6]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e2d259d-09af-42c1-b3df-83da8a3b4eea {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e2d259d-09af-42c1-b3df-83da8a3b4eea" returned: 0 in 0.390s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e2d259d-09af-42c1-b3df-83da8a3b4eea {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e2d259d-09af-42c1-b3df-83da8a3b4eea" returned: 0 in 0.122s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:02 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-quobyte-6e2d259d-09af-42c1-b3df-83da8a3b4eea" released by "delete_volume" :: held 0.672s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:02 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Created reservations ['bcb167b5-e54f-474c-923b-bb5344a50053', 'f1fc064e-b399-4b81-80c9-9034e1174a7e', 'cdb42a5e-33b8-4a65-b8bf-46b33363b189', 'ea97ecdc-1a17-42e0-9b5a-d76adf177627'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:36:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.130s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:02 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:36:02 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Deleted volume successfully.
Sep 18 22:36:02 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-ff95d60e-7a3d-4f5b-857e-46b910e34826 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-6e2d259d-09af-42c1-b3df-83da8a3b4eea-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "cinder-5ab86155-fd8b-4db3-b6e7-af63edde68f8-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-5ab86155-fd8b-4db3-b6e7-af63edde68f8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:03 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "cinder-quobyte-5ab86155-fd8b-4db3-b6e7-af63edde68f8" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-quobyte-5ab86155-fd8b-4db3-b6e7-af63edde68f8" acquired by "delete_volume" :: waited 0.015s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:03 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[11424a4b-bac5-454f-a807-9e35ecf75cb8]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ab86155-fd8b-4db3-b6e7-af63edde68f8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ab86155-fd8b-4db3-b6e7-af63edde68f8" returned: 0 in 0.416s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ab86155-fd8b-4db3-b6e7-af63edde68f8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5ab86155-fd8b-4db3-b6e7-af63edde68f8" returned: 0 in 0.093s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:04 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-quobyte-5ab86155-fd8b-4db3-b6e7-af63edde68f8" released by "delete_volume" :: held 0.658s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:04 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Created reservations ['492a0bd0-3419-42f1-a5c3-0a49d3f47062', '736243ea-9937-497d-9695-5dcdc776efd6', '697c076b-de0d-4378-95f7-914692e5277f', 'c8294806-8cef-4d74-bbe2-6ea040af2439'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:36:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:04 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:04 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:05 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.093s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:05 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:36:05 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Deleted volume successfully.
Sep 18 22:36:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1c4aa66e-ecf9-4f05-84e8-e5ef60806871 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-5ab86155-fd8b-4db3-b6e7-af63edde68f8-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "cinder-4514f38d-8bd4-431e-87d7-867aadfcb61f-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:05 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-4514f38d-8bd4-431e-87d7-867aadfcb61f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:06 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:06 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "cinder-quobyte-4514f38d-8bd4-431e-87d7-867aadfcb61f" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:06 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-quobyte-4514f38d-8bd4-431e-87d7-867aadfcb61f" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:06 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0035dc4d-7f5c-4bdc-a3e5-220e95176a41]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4514f38d-8bd4-431e-87d7-867aadfcb61f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4514f38d-8bd4-431e-87d7-867aadfcb61f" returned: 0 in 0.384s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4514f38d-8bd4-431e-87d7-867aadfcb61f {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4514f38d-8bd4-431e-87d7-867aadfcb61f" returned: 0 in 0.110s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:06 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-quobyte-4514f38d-8bd4-431e-87d7-867aadfcb61f" released by "delete_volume" :: held 0.647s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:06 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Created reservations ['69271b6d-e2bc-47b1-880e-43ece4b079f2', '3d8431df-bf72-46fe-b2c3-da12dba384d0', 'f8077281-de54-4d2d-8b1f-f25dc649decb', 'e2672cb3-ae0e-41ee-a194-77539c0db28a'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:36:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:07 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:07 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:07 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.107s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:07 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:36:07 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Deleted volume successfully.
Sep 18 22:36:07 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-73073069-fc26-43c3-b6c0-a5adfcca90f2 tempest-CreateVolumesFromImageTest-1055103443 None] Lock "cinder-4514f38d-8bd4-431e-87d7-867aadfcb61f-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:10 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Flow 'volume_create_manager' (e811d0e2-2183-4899-a8b3-d768e76e93b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a33c424-ffd0-4d1f-803d-c6cff477a3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a33c424-ffd0-4d1f-803d-c6cff477a3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-597727325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d310ef9-6004-4591-a722-293635e189cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921524f753f54daca23a89583261fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:11Z,use_quota=True,user_id='8acf5d89dde540ee8055369d66a55671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859950c1-964b-4fba-a045-effdfeabb4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859950c1-964b-4fba-a045-effdfeabb4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9615620-9369-4777-a7eb-c3baa1ae4667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9615620-9369-4777-a7eb-c3baa1ae4667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d310ef9-6004-4591-a722-293635e189cc', 'volume_name': 'volume-1d310ef9-6004-4591-a722-293635e189cc', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea02d0b-5371-4f1e-adbe-a73c2e9ba85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea02d0b-5371-4f1e-adbe-a73c2e9ba85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198af95d-f0de-4694-a689-d872181e17ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:10 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume 1d310ef9-6004-4591-a722-293635e189cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d310ef9-6004-4591-a722-293635e189cc', 'volume_size': 1}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-597727325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d310ef9-6004-4591-a722-293635e189cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921524f753f54daca23a89583261fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:11Z,use_quota=True,user_id='8acf5d89dde540ee8055369d66a55671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Creating volume 1d310ef9-6004-4591-a722-293635e189cc {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:36:10 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:36:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:10 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=134, name=volume-1d310ef9-6004-4591-a722-293635e189cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:36:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc 1073741824" returned: 0 in 0.330s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc" returned: 0 in 0.085s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:11 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] <== create_volume: return (486ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:36:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.498s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198af95d-f0de-4694-a689-d872181e17ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d310ef9-6004-4591-a722-293635e189cc', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bea4ac1-e245-437b-98ca-ed5ee6ad45b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:11 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume volume-1d310ef9-6004-4591-a722-293635e189cc (1d310ef9-6004-4591-a722-293635e189cc): created successfully
Sep 18 22:36:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bea4ac1-e245-437b-98ca-ed5ee6ad45b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Flow 'volume_create_manager' (e811d0e2-2183-4899-a8b3-d768e76e93b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:11 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-45a30cd0-6072-4c3d-9681-212f1770cc93 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Created volume successfully.
Sep 18 22:36:13 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:13 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Creating offline snapshot e46d9556-594e-4c95-8fcd-8f092f0ef9b4 of volume 1d310ef9-6004-4591-a722-293635e189cc {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:36:13 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02e9528-853a-477a-ae8c-ef460613d338]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc" returned: 0 in 0.385s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:13 devstack quobyte-client[83360]: System call of process 99401 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:36:13 devstack quobyte-client[83360]: System call of process 99401 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:36:13 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=135, name=volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:36:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4 1G" returned: 0 in 0.243s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1d310ef9-6004-4591-a722-293635e189cc -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "qemu-img rebase -u -b volume-1d310ef9-6004-4591-a722-293635e189cc -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4" returned: 0 in 0.124s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:13 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:36:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4" returned: 0 in 0.102s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:36:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4" returned: 0 in 0.111s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.info" returned: 0 in 0.087s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:36:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.info" returned: 0 in 0.084s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.445s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:14 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-dddc9b26-ee52-4268-a46e-f22d8329a586 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Create snapshot completed successfully
Sep 18 22:36:15 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Flow 'volume_create_manager' (c6a3ac40-bcc8-4290-98ab-1406b98e9e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0226ec-598d-41d5-ac1b-6957490b7c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0226ec-598d-41d5-ac1b-6957490b7c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-495464460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59c1d0c-add8-4f54-9d2e-dcac4e69ac69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921524f753f54daca23a89583261fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:15Z,use_quota=True,user_id='8acf5d89dde540ee8055369d66a55671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61304b43-9ba8-44a4-9736-d2eb57f6b42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61304b43-9ba8-44a4-9736-d2eb57f6b42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff17d3d-b9ae-4e1d-b1e4-5a409642bc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff17d3d-b9ae-4e1d-b1e4-5a409642bc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a59c1d0c-add8-4f54-9d2e-dcac4e69ac69', 'volume_name': 'volume-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba9ebf8-9da8-4cfa-8a55-12a4d95714c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ba9ebf8-9da8-4cfa-8a55-12a4d95714c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c782419d-f931-417d-859c-0895815ba10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:15 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume a59c1d0c-add8-4f54-9d2e-dcac4e69ac69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69', 'volume_size': 1}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-495464460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a59c1d0c-add8-4f54-9d2e-dcac4e69ac69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921524f753f54daca23a89583261fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:15Z,use_quota=True,user_id='8acf5d89dde540ee8055369d66a55671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Creating volume a59c1d0c-add8-4f54-9d2e-dcac4e69ac69 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:36:15 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:36:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:15 devstack quobyte-client[83360]: System call of process 99411 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:36:15 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=137, name=volume-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:36:16 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Flow 'volume_create_manager' (c33cd2a1-1c36-4b4c-a474-65c80881c1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c601c28-779d-49d6-b6ca-130ed591f9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69 1073741824" returned: 0 in 0.678s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c601c28-779d-49d6-b6ca-130ed591f9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1342251203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f5270c-2a6c-4592-aaee-78ab1c3cb934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921524f753f54daca23a89583261fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:16Z,use_quota=True,user_id='8acf5d89dde540ee8055369d66a55671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b607f3-8fb7-4447-9546-827feb57b5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b607f3-8fb7-4447-9546-827feb57b5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae12e5a-a02f-4001-beac-3939d59db271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae12e5a-a02f-4001-beac-3939d59db271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f5270c-2a6c-4592-aaee-78ab1c3cb934', 'volume_name': 'volume-35f5270c-2a6c-4592-aaee-78ab1c3cb934', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1aeb484-fe36-4514-9068-8ca00d2a9230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1aeb484-fe36-4514-9068-8ca00d2a9230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c85ca25-3a83-4d7d-9977-57301918ca34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:16 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume 35f5270c-2a6c-4592-aaee-78ab1c3cb934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f5270c-2a6c-4592-aaee-78ab1c3cb934', 'volume_size': 1}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69" returned: 0 in 0.368s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] <== create_volume: return (1072ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.136s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1342251203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f5270c-2a6c-4592-aaee-78ab1c3cb934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921524f753f54daca23a89583261fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:16Z,use_quota=True,user_id='8acf5d89dde540ee8055369d66a55671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Creating volume 35f5270c-2a6c-4592-aaee-78ab1c3cb934 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:36:16 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-35f5270c-2a6c-4592-aaee-78ab1c3cb934 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:16 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:16 devstack quobyte-client[83360]: System call of process 99415 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:36:16 devstack quobyte-client[83360]: System call of process 99415 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:36:16 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:36:17 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=138, name=volume-35f5270c-2a6c-4592-aaee-78ab1c3cb934, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Flow 'volume_create_manager' (312a5954-7c12-4196-9d7e-6d75b9eac627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099c18de-b6be-403a-98e1-be97012b3049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c782419d-f931-417d-859c-0895815ba10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af31a1c4-017e-47ca-90b0-5269e02f557a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099c18de-b6be-403a-98e1-be97012b3049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-607547475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3995af66-a51c-405c-a97c-cc8f14e7bc0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921524f753f54daca23a89583261fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:16Z,use_quota=True,user_id='8acf5d89dde540ee8055369d66a55671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c1d50a-1ad0-4581-aae2-0e6212f4de6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c1d50a-1ad0-4581-aae2-0e6212f4de6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc8fcac-d9fb-44a0-b812-1f3e98314c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc8fcac-d9fb-44a0-b812-1f3e98314c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3995af66-a51c-405c-a97c-cc8f14e7bc0a', 'volume_name': 'volume-3995af66-a51c-405c-a97c-cc8f14e7bc0a', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8120b4b4-99fe-4199-9019-117b952692c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8120b4b4-99fe-4199-9019-117b952692c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937ab650-6441-4c07-8a43-586471ac98bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:17 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume 3995af66-a51c-405c-a97c-cc8f14e7bc0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3995af66-a51c-405c-a97c-cc8f14e7bc0a', 'volume_size': 1}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:17 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume volume-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69 (a59c1d0c-add8-4f54-9d2e-dcac4e69ac69): created successfully
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af31a1c4-017e-47ca-90b0-5269e02f557a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Flow 'volume_create_manager' (c6a3ac40-bcc8-4290-98ab-1406b98e9e28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-35f5270c-2a6c-4592-aaee-78ab1c3cb934 1073741824" returned: 0 in 0.749s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-35f5270c-2a6c-4592-aaee-78ab1c3cb934 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:17 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Flow 'volume_create_manager' (5d544e1b-5409-440f-96b1-56887d284c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c6d6c8-d078-4187-a989-dccbcba267b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:17 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-34191e7a-5431-4270-9700-0ade83638a37 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Created volume successfully.
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-35f5270c-2a6c-4592-aaee-78ab1c3cb934" returned: 0 in 0.443s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c6d6c8-d078-4187-a989-dccbcba267b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-732839440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b81cfb-06be-4c68-a476-e244e448d7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921524f753f54daca23a89583261fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:17Z,use_quota=True,user_id='8acf5d89dde540ee8055369d66a55671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fbf5d7-265d-42b6-9234-6594547f0dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fbf5d7-265d-42b6-9234-6594547f0dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f28fde-5640-433d-8554-33203088e4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f28fde-5640-433d-8554-33203088e4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b81cfb-06be-4c68-a476-e244e448d7cd', 'volume_name': 'volume-34b81cfb-06be-4c68-a476-e244e448d7cd', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa5b5d8-3cca-4f5e-8812-ab50e05f715f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa5b5d8-3cca-4f5e-8812-ab50e05f715f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57eb6dc-0af1-47be-af48-500689785615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:17 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume 34b81cfb-06be-4c68-a476-e244e448d7cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b81cfb-06be-4c68-a476-e244e448d7cd', 'volume_size': 1}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] <== create_volume: return (1284ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.545s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-607547475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3995af66-a51c-405c-a97c-cc8f14e7bc0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921524f753f54daca23a89583261fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:16Z,use_quota=True,user_id='8acf5d89dde540ee8055369d66a55671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Creating volume 3995af66-a51c-405c-a97c-cc8f14e7bc0a {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:36:17 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:36:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3995af66-a51c-405c-a97c-cc8f14e7bc0a 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:18 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:18 devstack quobyte-client[83360]: System call of process 99419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:36:18 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=139, name=volume-3995af66-a51c-405c-a97c-cc8f14e7bc0a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Flow 'volume_create_manager' (2ee164c5-2a15-439a-bc9a-959583f194b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6554460-6f60-45fe-992f-3abd17ea6eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6554460-6f60-45fe-992f-3abd17ea6eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-805606907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921524f753f54daca23a89583261fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:17Z,use_quota=True,user_id='8acf5d89dde540ee8055369d66a55671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fddb6b-1188-440f-a25f-d43c75e94219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83fddb6b-1188-440f-a25f-d43c75e94219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3a51d5-e100-4c4f-99cc-22c8c6e31008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3a51d5-e100-4c4f-99cc-22c8c6e31008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8', 'volume_name': 'volume-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bef698-4736-4260-b59a-37269730426f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bef698-4736-4260-b59a-37269730426f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261b6e2f-da9b-45bd-91d5-1f1e1bd8f064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:18 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume 47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8', 'volume_size': 1}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c85ca25-3a83-4d7d-9977-57301918ca34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f5270c-2a6c-4592-aaee-78ab1c3cb934', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82e517d-822c-4ce8-aa42-b9cfec6ef3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3995af66-a51c-405c-a97c-cc8f14e7bc0a 1073741824" returned: 0 in 0.554s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3995af66-a51c-405c-a97c-cc8f14e7bc0a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:18 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume volume-35f5270c-2a6c-4592-aaee-78ab1c3cb934 (35f5270c-2a6c-4592-aaee-78ab1c3cb934): created successfully
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82e517d-822c-4ce8-aa42-b9cfec6ef3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Flow 'volume_create_manager' (c33cd2a1-1c36-4b4c-a474-65c80881c1a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3995af66-a51c-405c-a97c-cc8f14e7bc0a" returned: 0 in 0.329s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] <== create_volume: return (909ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.942s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-732839440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b81cfb-06be-4c68-a476-e244e448d7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921524f753f54daca23a89583261fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:17Z,use_quota=True,user_id='8acf5d89dde540ee8055369d66a55671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Creating volume 34b81cfb-06be-4c68-a476-e244e448d7cd {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:36:18 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:36:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-34b81cfb-06be-4c68-a476-e244e448d7cd 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:19 devstack quobyte-client[83360]: System call of process 99423 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:36:19 devstack quobyte-client[83360]: System call of process 99423 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:36:19 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=140, name=volume-34b81cfb-06be-4c68-a476-e244e448d7cd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:36:19 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-6a1ca845-b19f-4497-a9d3-330f0a6943e7 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Created volume successfully.
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937ab650-6441-4c07-8a43-586471ac98bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3995af66-a51c-405c-a97c-cc8f14e7bc0a', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44df7fbd-5980-488c-8d9e-c3195b29cefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:19 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume volume-3995af66-a51c-405c-a97c-cc8f14e7bc0a (3995af66-a51c-405c-a97c-cc8f14e7bc0a): created successfully
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44df7fbd-5980-488c-8d9e-c3195b29cefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Flow 'volume_create_manager' (312a5954-7c12-4196-9d7e-6d75b9eac627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-34b81cfb-06be-4c68-a476-e244e448d7cd 1073741824" returned: 0 in 0.424s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-34b81cfb-06be-4c68-a476-e244e448d7cd {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-34b81cfb-06be-4c68-a476-e244e448d7cd" returned: 0 in 0.128s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] <== create_volume: return (599ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.618s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.080s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-805606907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921524f753f54daca23a89583261fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:17Z,use_quota=True,user_id='8acf5d89dde540ee8055369d66a55671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Creating volume 47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:36:19 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:19 devstack quobyte-client[83360]: System call of process 99427 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:36:19 devstack quobyte-client[83360]: System call of process 99427 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:36:19 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=141, name=volume-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:36:19 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-4f34d5d9-8b02-41a6-a716-f9c62406c058 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Created volume successfully.
Sep 18 22:36:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e57eb6dc-0af1-47be-af48-500689785615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b81cfb-06be-4c68-a476-e244e448d7cd', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b610f80-c3b7-4c1e-8b02-740df8a22bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:20 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume volume-34b81cfb-06be-4c68-a476-e244e448d7cd (34b81cfb-06be-4c68-a476-e244e448d7cd): created successfully
Sep 18 22:36:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b610f80-c3b7-4c1e-8b02-740df8a22bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Flow 'volume_create_manager' (5d544e1b-5409-440f-96b1-56887d284c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8 1073741824" returned: 0 in 0.486s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8" returned: 0 in 0.137s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] <== create_volume: return (678ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:36:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:20 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-82b7c600-3f89-4ea0-b90d-80039a1786ee tempest-CreateVolumesFromSnapshotTest-1828889337 None] Created volume successfully.
Sep 18 22:36:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261b6e2f-da9b-45bd-91d5-1f1e1bd8f064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c1ef4c-d699-4eae-a6a4-e021593d33e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:20 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume volume-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8 (47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8): created successfully
Sep 18 22:36:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c1ef4c-d699-4eae-a6a4-e021593d33e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Flow 'volume_create_manager' (2ee164c5-2a15-439a-bc9a-959583f194b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:20 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-8ac8df03-dad5-41b9-8e09-135389795322 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Created volume successfully.
Sep 18 22:36:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "cinder-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:21 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "cinder-quobyte-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:21 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f3228f-91f7-4482-962d-6ffeb08a8752]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8" returned: 0 in 0.392s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8" returned: 0 in 0.104s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8" released by "delete_volume" :: held 0.647s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:22 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Created reservations ['37bc02e9-8230-481e-883a-4b4797ce8f52', '9037b621-e78c-443d-a03d-708ae431ec9d', '2d3e4f00-f5ab-4480-a5ae-9f6081fe09fb', '615293c4-c32e-4121-a7dd-12a24f0c6d9a'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:36:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:22 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.100s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:22 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:36:22 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Deleted volume successfully.
Sep 18 22:36:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c95dc0ac-b4d8-468c-a138-a8be796a845c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-47ca3f4b-3a66-430c-9c3b-bff5c2ec2bb8-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "cinder-34b81cfb-06be-4c68-a476-e244e448d7cd-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-34b81cfb-06be-4c68-a476-e244e448d7cd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:23 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "cinder-quobyte-34b81cfb-06be-4c68-a476-e244e448d7cd" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-34b81cfb-06be-4c68-a476-e244e448d7cd" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:23 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f956be30-eeb6-4414-ae16-4ebe177e3cb0]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-34b81cfb-06be-4c68-a476-e244e448d7cd {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-34b81cfb-06be-4c68-a476-e244e448d7cd" returned: 0 in 0.385s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-34b81cfb-06be-4c68-a476-e244e448d7cd {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-34b81cfb-06be-4c68-a476-e244e448d7cd" returned: 0 in 0.103s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:24 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-34b81cfb-06be-4c68-a476-e244e448d7cd" released by "delete_volume" :: held 0.637s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:24 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Created reservations ['50809c1b-5ec2-49a7-b64b-a0e70cad76ae', '4cad132f-be8f-47f4-b16f-f4eb114a6aa1', '63157514-9467-4a8a-9d30-cece42052c7f', '54b891fe-fadf-4ff9-8958-45b982cd79ab'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:36:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.090s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:24 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:36:24 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Deleted volume successfully.
Sep 18 22:36:24 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-7427305e-2b5e-4e36-9a34-e5bf97571790 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-34b81cfb-06be-4c68-a476-e244e448d7cd-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "cinder-3995af66-a51c-405c-a97c-cc8f14e7bc0a-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-3995af66-a51c-405c-a97c-cc8f14e7bc0a-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:25 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "cinder-quobyte-3995af66-a51c-405c-a97c-cc8f14e7bc0a" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-3995af66-a51c-405c-a97c-cc8f14e7bc0a" acquired by "delete_volume" :: waited 0.010s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:26 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a80af7-f1f6-45c0-a9f2-5f34c2b3367d]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3995af66-a51c-405c-a97c-cc8f14e7bc0a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3995af66-a51c-405c-a97c-cc8f14e7bc0a" returned: 0 in 0.390s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3995af66-a51c-405c-a97c-cc8f14e7bc0a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3995af66-a51c-405c-a97c-cc8f14e7bc0a" returned: 0 in 0.091s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:26 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-3995af66-a51c-405c-a97c-cc8f14e7bc0a" released by "delete_volume" :: held 0.644s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:26 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Created reservations ['f000189b-5988-4452-98a7-b99b684eb905', 'b0cf05ce-131e-47ad-82f9-e5572f3220de', 'e1a8d295-57c5-4007-b27b-cebe0fe45a9b', 'a117de8a-7dab-4ce2-8edf-ad1396e79133'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:36:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:27 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.085s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:27 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:36:27 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Deleted volume successfully.
Sep 18 22:36:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8b3d158b-0490-4576-ab99-bab71c9c2f94 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-3995af66-a51c-405c-a97c-cc8f14e7bc0a-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "cinder-35f5270c-2a6c-4592-aaee-78ab1c3cb934-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-35f5270c-2a6c-4592-aaee-78ab1c3cb934-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:27 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "cinder-quobyte-35f5270c-2a6c-4592-aaee-78ab1c3cb934" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-35f5270c-2a6c-4592-aaee-78ab1c3cb934" acquired by "delete_volume" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:28 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[77566869-9dc4-44ef-8c3f-054cc4575d2f]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-35f5270c-2a6c-4592-aaee-78ab1c3cb934 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-35f5270c-2a6c-4592-aaee-78ab1c3cb934" returned: 0 in 0.376s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-35f5270c-2a6c-4592-aaee-78ab1c3cb934 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-35f5270c-2a6c-4592-aaee-78ab1c3cb934" returned: 0 in 0.106s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:28 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-35f5270c-2a6c-4592-aaee-78ab1c3cb934" released by "delete_volume" :: held 0.643s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:28 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Created reservations ['2c5c7b25-1285-456f-9610-318393e854d3', '05de221f-09ce-4e11-b56a-4bc99eae8487', '72071b81-ed48-448e-bb02-16234de7dc6d', '8c9bc6d2-067b-4107-bbd8-372a9ee84a32'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:36:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.105s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:29 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:36:29 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Deleted volume successfully.
Sep 18 22:36:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-8512067f-8a61-4aa1-a11c-4232fe17168a tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-35f5270c-2a6c-4592-aaee-78ab1c3cb934-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "cinder-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:30 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "cinder-quobyte-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69" acquired by "delete_volume" :: waited 0.018s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:30 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[815aa710-125a-4dc1-a48d-7a02161dd03b]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69" returned: 0 in 0.392s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69" returned: 0 in 0.121s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69" released by "delete_volume" :: held 0.725s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:31 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Created reservations ['c9fc50c5-d295-4645-bc69-cbbee29bbb5f', '916ee744-c7e8-4ca5-8150-a52cbb1e382b', 'c14cf932-cbf7-4211-9ff7-2250bb0bcdf2', '127fc017-c6aa-494d-bd6a-6c08b1e42547'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:36:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.113s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:31 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:36:31 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Deleted volume successfully.
Sep 18 22:36:31 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a54edac6-51d3-42d0-b9d9-769ca5291b8c tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-a59c1d0c-add8-4f54-9d2e-dcac4e69ac69-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "cinder-e46d9556-594e-4c95-8fcd-8f092f0ef9b4-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-e46d9556-594e-4c95-8fcd-8f092f0ef9b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:32 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "cinder-quobyte-1d310ef9-6004-4591-a722-293635e189cc" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-1d310ef9-6004-4591-a722-293635e189cc" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "cinder-quobyte-e46d9556-594e-4c95-8fcd-8f092f0ef9b4" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-e46d9556-594e-4c95-8fcd-8f092f0ef9b4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:32 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Deleting offline snapshot e46d9556-594e-4c95-8fcd-8f092f0ef9b4 of volume 1d310ef9-6004-4591-a722-293635e189cc {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:36:32 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] snapshot_file for this snap is: volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:36:32 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c63333-8bb1-40e5-9dcd-d9fb948ae864]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4" returned: 0 in 0.392s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:32 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d310ef9-6004-4591-a722-293635e189cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:36:32 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb955a2-790f-438b-9f8c-e0ccc53c469c]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc" returned: 0 in 0.386s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4" returned: 0 in 0.245s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc.e46d9556-594e-4c95-8fcd-8f092f0ef9b4" returned: 0 in 0.087s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-e46d9556-594e-4c95-8fcd-8f092f0ef9b4" released by "_delete_snapshot" :: held 1.412s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:33 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-1d310ef9-6004-4591-a722-293635e189cc" released by "delete_snapshot" :: held 1.456s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:34 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Created reservations ['2cf9699c-b65b-4cfc-a62b-589037e80215', '8a10aaca-265c-4d66-96cb-5134cc29e9bf', 'acf785d1-b32b-4282-8dd0-66be40476379', '9a4e2439-e249-4aa4-9216-a40d4421a190'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:36:34 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Delete snapshot completed successfully.
Sep 18 22:36:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-202e7134-f681-48f4-a8c3-f38e17385efc tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-e46d9556-594e-4c95-8fcd-8f092f0ef9b4-delete_snapshot" released by "delete_snapshot" :: held 1.864s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "cinder-1d310ef9-6004-4591-a722-293635e189cc-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-1d310ef9-6004-4591-a722-293635e189cc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:34 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "cinder-quobyte-1d310ef9-6004-4591-a722-293635e189cc" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-1d310ef9-6004-4591-a722-293635e189cc" acquired by "delete_volume" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:34 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b26903-9ff6-4542-8dc8-e98e5767345f]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc" returned: 0 in 0.442s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1d310ef9-6004-4591-a722-293635e189cc" returned: 0 in 0.103s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:35 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-quobyte-1d310ef9-6004-4591-a722-293635e189cc" released by "delete_volume" :: held 0.701s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:35 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Created reservations ['db8db3fc-ec29-48b5-a365-27ee99a8924d', 'a3a87ae3-4f35-4967-b8ed-ec1296004f12', 'aef33a74-24fc-498c-becd-864e72944492', '46260d00-25ae-42d4-8aec-2bc88ebc4134'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:36:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:35 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.106s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:35 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:36:35 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Deleted volume successfully.
Sep 18 22:36:36 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-d435df81-fb3d-4d0b-9d51-46e27ff7e8f9 tempest-CreateVolumesFromSnapshotTest-1828889337 None] Lock "cinder-1d310ef9-6004-4591-a722-293635e189cc-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:39 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Flow 'volume_create_manager' (4edde247-f945-4253-81d7-ec155c5ecc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9083f563-6864-4847-9578-ba0e434914a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9083f563-6864-4847-9578-ba0e434914a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7367c8e1-da0a-4b69-8c7f-70b004fa2074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80564311278448f086db422e502b0d82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:39Z,use_quota=True,user_id='7d0e7c3571f44926928c218446be427f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42af4fa5-c457-4e05-ac14-e50aca7e3d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42af4fa5-c457-4e05-ac14-e50aca7e3d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2344922a-bcd9-461c-aaeb-549a622143c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2344922a-bcd9-461c-aaeb-549a622143c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7367c8e1-da0a-4b69-8c7f-70b004fa2074', 'volume_name': 'volume-7367c8e1-da0a-4b69-8c7f-70b004fa2074', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c7df37-d349-4380-9749-5c1783240aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c7df37-d349-4380-9749-5c1783240aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1f5deb-66e4-4cea-b9ba-353bf6e31a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:39 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Volume 7367c8e1-da0a-4b69-8c7f-70b004fa2074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7367c8e1-da0a-4b69-8c7f-70b004fa2074', 'volume_size': 1}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7367c8e1-da0a-4b69-8c7f-70b004fa2074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80564311278448f086db422e502b0d82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:39Z,use_quota=True,user_id='7d0e7c3571f44926928c218446be427f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Creating volume 7367c8e1-da0a-4b69-8c7f-70b004fa2074 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:36:39 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7367c8e1-da0a-4b69-8c7f-70b004fa2074 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:39 devstack quobyte-client[83360]: System call of process 99511 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:36:39 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=142, name=volume-7367c8e1-da0a-4b69-8c7f-70b004fa2074, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:36:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7367c8e1-da0a-4b69-8c7f-70b004fa2074 1073741824" returned: 0 in 0.322s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7367c8e1-da0a-4b69-8c7f-70b004fa2074 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7367c8e1-da0a-4b69-8c7f-70b004fa2074" returned: 0 in 0.087s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] <== create_volume: return (482ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:36:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.495s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1f5deb-66e4-4cea-b9ba-353bf6e31a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7367c8e1-da0a-4b69-8c7f-70b004fa2074', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db51d9b8-f00e-41fe-9d65-5a0c6e4ac27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:40 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Volume volume-7367c8e1-da0a-4b69-8c7f-70b004fa2074 (7367c8e1-da0a-4b69-8c7f-70b004fa2074): created successfully
Sep 18 22:36:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db51d9b8-f00e-41fe-9d65-5a0c6e4ac27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Flow 'volume_create_manager' (4edde247-f945-4253-81d7-ec155c5ecc15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:40 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-cc483021-d823-4f24-a20d-5dcaf7ab67d3 tempest-CinderUnicodeTest-1913148972 None] Created volume successfully.
Sep 18 22:36:41 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:41 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Flow 'volume_create_manager' (41c62880-02fe-467c-a4a0-1d64e685be2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f31a8ab-5892-41ba-8858-334bf2803e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f31a8ab-5892-41ba-8858-334bf2803e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1792422470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e2d653-1999-43c8-a424-30db60fd6b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80564311278448f086db422e502b0d82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:42Z,use_quota=True,user_id='7d0e7c3571f44926928c218446be427f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b86369-4f55-473f-9d2c-8f8d7c5f8e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b86369-4f55-473f-9d2c-8f8d7c5f8e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75416f9b-543a-4f53-8d1b-dff0721ba6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75416f9b-543a-4f53-8d1b-dff0721ba6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39e2d653-1999-43c8-a424-30db60fd6b50', 'volume_name': 'volume-39e2d653-1999-43c8-a424-30db60fd6b50', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9572961-276d-4573-98ca-661fd4ec3338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9572961-276d-4573-98ca-661fd4ec3338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63da839b-1406-4649-95ee-900e87a1ec42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:42 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Volume 39e2d653-1999-43c8-a424-30db60fd6b50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39e2d653-1999-43c8-a424-30db60fd6b50', 'volume_size': 1}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:36:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1792422470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39e2d653-1999-43c8-a424-30db60fd6b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80564311278448f086db422e502b0d82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:36:42Z,use_quota=True,user_id='7d0e7c3571f44926928c218446be427f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Creating volume 39e2d653-1999-43c8-a424-30db60fd6b50 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:36:42 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:42 devstack quobyte-client[83360]: System call of process 99516 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:36:42 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=143, name=volume-39e2d653-1999-43c8-a424-30db60fd6b50, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50 1073741824" returned: 0 in 0.319s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50" returned: 0 in 0.089s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] <== create_volume: return (483ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.497s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63da839b-1406-4649-95ee-900e87a1ec42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39e2d653-1999-43c8-a424-30db60fd6b50', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fccb973-bdde-4e09-a980-2cde556e3222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:36:42 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Volume volume-39e2d653-1999-43c8-a424-30db60fd6b50 (39e2d653-1999-43c8-a424-30db60fd6b50): created successfully
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fccb973-bdde-4e09-a980-2cde556e3222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:36:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Flow 'volume_create_manager' (41c62880-02fe-467c-a4a0-1d64e685be2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:36:42 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-9b6d0e2f-71f3-4cab-ae48-a262199c4f8a tempest-CinderUnicodeTest-1913148972 None] Created volume successfully.
Sep 18 22:36:44 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] Creating offline snapshot 4755039c-62b5-4d34-91fb-9f72c5e5c79d of volume 39e2d653-1999-43c8-a424-30db60fd6b50 {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:36:44 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[557023d8-2a52-40a2-9d46-52f4dd6de098]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50" returned: 0 in 0.413s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:45 devstack quobyte-client[83360]: System call of process 99523 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:36:45 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=144, name=volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:36:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d 1G" returned: 0 in 0.241s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): qemu-img rebase -u -b volume-39e2d653-1999-43c8-a424-30db60fd6b50 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] CMD "qemu-img rebase -u -b volume-39e2d653-1999-43c8-a424-30db60fd6b50 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d" returned: 0 in 0.149s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:36:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d" returned: 0 in 0.085s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:36:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d" returned: 0 in 0.111s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.info" returned: 0 in 0.094s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:36:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.info" returned: 0 in 0.087s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.531s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:46 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-adffe433-d1ec-4529-b1bc-90a33adbcb87 tempest-CinderUnicodeTest-1913148972 None] Create snapshot completed successfully
Sep 18 22:36:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Acquiring lock "cinder-4755039c-62b5-4d34-91fb-9f72c5e5c79d-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Lock "cinder-4755039c-62b5-4d34-91fb-9f72c5e5c79d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:46 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Acquiring lock "cinder-quobyte-39e2d653-1999-43c8-a424-30db60fd6b50" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Lock "cinder-quobyte-39e2d653-1999-43c8-a424-30db60fd6b50" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Acquiring lock "cinder-quobyte-4755039c-62b5-4d34-91fb-9f72c5e5c79d" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Lock "cinder-quobyte-4755039c-62b5-4d34-91fb-9f72c5e5c79d" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Deleting offline snapshot 4755039c-62b5-4d34-91fb-9f72c5e5c79d of volume 39e2d653-1999-43c8-a424-30db60fd6b50 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:36:46 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] snapshot_file for this snap is: volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:36:46 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe2a565-44ce-4b47-905e-4b7a66b17952]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:47 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:36:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:47 devstack quobyte-client[83360]: System call of process 99533 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:36:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d" returned: 0 in 0.469s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39e2d653-1999-43c8-a424-30db60fd6b50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:36:47 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4fcd2f-383a-46b7-aaca-8fb795a4024b]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.247s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:36:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50" returned: 0 in 0.447s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d" returned: 0 in 0.210s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50.4755039c-62b5-4d34-91fb-9f72c5e5c79d" returned: 0 in 0.086s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:48 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Lock "cinder-quobyte-4755039c-62b5-4d34-91fb-9f72c5e5c79d" released by "_delete_snapshot" :: held 1.556s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:48 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Lock "cinder-quobyte-39e2d653-1999-43c8-a424-30db60fd6b50" released by "delete_snapshot" :: held 1.624s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:48 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Created reservations ['7b718ba3-f4e3-4da3-a0d0-0c7798f95835', '15ef38bc-53f3-4c79-aa84-30379a04912f', '7c5860e8-fb94-46a1-af79-2f1aed202fa7', 'a1e59408-0573-4523-8ced-21b64f9d101f'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:36:48 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Delete snapshot completed successfully.
Sep 18 22:36:48 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-83d3dce0-cd1e-45b8-a8c2-50d16d8e74d6 tempest-CinderUnicodeTest-1913148972 None] Lock "cinder-4755039c-62b5-4d34-91fb-9f72c5e5c79d-delete_snapshot" released by "delete_snapshot" :: held 2.104s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Acquiring lock "cinder-39e2d653-1999-43c8-a424-30db60fd6b50-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Lock "cinder-39e2d653-1999-43c8-a424-30db60fd6b50-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:49 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=81,cinder:UPDATE=131,cinder:DELETE=13,cinder:INSERT=26 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:36:49 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Acquiring lock "cinder-quobyte-39e2d653-1999-43c8-a424-30db60fd6b50" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Lock "cinder-quobyte-39e2d653-1999-43c8-a424-30db60fd6b50" acquired by "delete_volume" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:49 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a66319c-2cfc-4386-87a3-91dd250f12ea]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:50 devstack quobyte-client[83360]: System call of process 99544 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:36:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50" returned: 0 in 0.435s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-39e2d653-1999-43c8-a424-30db60fd6b50" returned: 0 in 0.105s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:50 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Lock "cinder-quobyte-39e2d653-1999-43c8-a424-30db60fd6b50" released by "delete_volume" :: held 0.706s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:50 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=82,cinder:UPDATE=124,cinder:DELETE=13,cinder:INSERT=26 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:36:50 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Created reservations ['25b82047-9ba7-4ff6-bf67-862cde25b05c', '1efc9263-42b3-4230-8c9d-d93261667818', '941764d5-45d7-4992-851e-470bc2c1cf85', '8b44b737-5205-4b84-8c99-f2d3a29f2bff'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:36:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.117s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:51 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:36:51 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Deleted volume successfully.
Sep 18 22:36:51 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-afa0f1c3-c2a1-4b71-b7fd-b9b4760a01cb tempest-CinderUnicodeTest-1913148972 None] Lock "cinder-39e2d653-1999-43c8-a424-30db60fd6b50-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Acquiring lock "cinder-7367c8e1-da0a-4b69-8c7f-70b004fa2074-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Lock "cinder-7367c8e1-da0a-4b69-8c7f-70b004fa2074-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:52 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:36:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Acquiring lock "cinder-quobyte-7367c8e1-da0a-4b69-8c7f-70b004fa2074" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:36:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Lock "cinder-quobyte-7367c8e1-da0a-4b69-8c7f-70b004fa2074" acquired by "delete_volume" :: waited 0.023s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:36:52 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddaac35-af35-4482-ba67-5ecb302213b6]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:36:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7367c8e1-da0a-4b69-8c7f-70b004fa2074 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7367c8e1-da0a-4b69-8c7f-70b004fa2074" returned: 0 in 0.401s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7367c8e1-da0a-4b69-8c7f-70b004fa2074 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7367c8e1-da0a-4b69-8c7f-70b004fa2074" returned: 0 in 0.090s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Lock "cinder-quobyte-7367c8e1-da0a-4b69-8c7f-70b004fa2074" released by "delete_volume" :: held 0.664s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:36:53 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Created reservations ['bb10d1bd-f83b-41c5-b74c-2c5fd1b8ace5', 'de8f43ba-7e48-45cd-a04f-16f6c0306d89', 'cbb6f382-874e-4448-88d0-67b83bd2fd99', '40ff1b02-2d88-4767-bb6b-1343dd3598c7'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:36:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:36:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:36:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:36:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:36:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:36:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:36:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.091s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:36:53 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:36:53 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Deleted volume successfully.
Sep 18 22:36:53 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c9bddbb3-42e0-44d0-bbfd-cd05b6cf4a67 tempest-CinderUnicodeTest-1913148972 None] Lock "cinder-7367c8e1-da0a-4b69-8c7f-70b004fa2074-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:37:03 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=11,cinder:INSERT=8,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:37:03 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=15,cinder:SELECT=6,cinder:DELETE=1 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:37:12 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Flow 'volume_create_manager' (b8c47ba6-00ca-4d27-a6a9-0a0d26a02b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98eda6d-bd7c-4363-a9fe-4ccca73b1f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98eda6d-bd7c-4363-a9fe-4ccca73b1f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1409336354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bcdfd8-a27a-4f7d-b84e-97cb8d879070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50454317e4c24166b0d83f1155b40f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:12Z,use_quota=True,user_id='9b391dae95ae4706926d1b2c928d2fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c93906-d8b7-4467-93d1-0007709bee00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c93906-d8b7-4467-93d1-0007709bee00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587c475d-a5b0-424c-898e-1333e2947984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587c475d-a5b0-424c-898e-1333e2947984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7bcdfd8-a27a-4f7d-b84e-97cb8d879070', 'volume_name': 'volume-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873f1485-ff96-4973-bfdc-aeaf42f4a2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873f1485-ff96-4973-bfdc-aeaf42f4a2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273d204a-a9f1-4a18-ab93-d4d652644deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:12 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Volume d7bcdfd8-a27a-4f7d-b84e-97cb8d879070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070', 'volume_size': 1}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1409336354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bcdfd8-a27a-4f7d-b84e-97cb8d879070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50454317e4c24166b0d83f1155b40f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:12Z,use_quota=True,user_id='9b391dae95ae4706926d1b2c928d2fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Creating volume d7bcdfd8-a27a-4f7d-b84e-97cb8d879070 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:37:12 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:37:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:13 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=146, name=volume-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070 1073741824" returned: 0 in 0.893s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:14 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Flow 'volume_create_manager' (791d9a60-6635-4798-8883-21f032f9cc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b2b2e4-85b5-417c-97bc-fd748d1cad7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b2b2e4-85b5-417c-97bc-fd748d1cad7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1172683033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d93136f-b794-4d65-acbc-3869d18b8c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50454317e4c24166b0d83f1155b40f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:13Z,use_quota=True,user_id='9b391dae95ae4706926d1b2c928d2fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43f87db-c7f6-44c7-8d3d-762b9e251788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43f87db-c7f6-44c7-8d3d-762b9e251788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18d22b7-4c53-4d01-9709-826d98b03746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18d22b7-4c53-4d01-9709-826d98b03746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d93136f-b794-4d65-acbc-3869d18b8c6a', 'volume_name': 'volume-9d93136f-b794-4d65-acbc-3869d18b8c6a', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df325c6-79c3-47c7-8ce5-11862c916488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df325c6-79c3-47c7-8ce5-11862c916488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f41f81-3c42-46cb-85c9-eab53cc06247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:14 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Volume 9d93136f-b794-4d65-acbc-3869d18b8c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d93136f-b794-4d65-acbc-3869d18b8c6a', 'volume_size': 1}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:14 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Flow 'volume_create_manager' (11584c13-e3b1-4abb-b91d-911ff384a5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db6a596-e986-4664-bd61-74a78ba9368d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070" returned: 0 in 1.102s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] <== create_volume: return (2036ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.113s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1172683033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d93136f-b794-4d65-acbc-3869d18b8c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50454317e4c24166b0d83f1155b40f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:13Z,use_quota=True,user_id='9b391dae95ae4706926d1b2c928d2fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Creating volume 9d93136f-b794-4d65-acbc-3869d18b8c6a {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:37:14 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:37:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9d93136f-b794-4d65-acbc-3869d18b8c6a 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:14 devstack quobyte-client[83360]: System call of process 99610 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:15 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=147, name=volume-9d93136f-b794-4d65-acbc-3869d18b8c6a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db6a596-e986-4664-bd61-74a78ba9368d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1770609338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6579d00-180a-4cd9-854b-8329193e30bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50454317e4c24166b0d83f1155b40f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:13Z,use_quota=True,user_id='9b391dae95ae4706926d1b2c928d2fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf610e0-1d0d-49ea-81dc-1a1f22008343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf610e0-1d0d-49ea-81dc-1a1f22008343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75372c78-69e4-482a-9c9c-371feeb9bd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75372c78-69e4-482a-9c9c-371feeb9bd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6579d00-180a-4cd9-854b-8329193e30bf', 'volume_name': 'volume-a6579d00-180a-4cd9-854b-8329193e30bf', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cfc320-317b-472a-96e9-785f979e3beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7cfc320-317b-472a-96e9-785f979e3beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847ad364-391a-4e6f-876e-725451e70587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:15 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Volume a6579d00-180a-4cd9-854b-8329193e30bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6579d00-180a-4cd9-854b-8329193e30bf', 'volume_size': 1}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9d93136f-b794-4d65-acbc-3869d18b8c6a 1073741824" returned: 0 in 0.537s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9d93136f-b794-4d65-acbc-3869d18b8c6a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273d204a-a9f1-4a18-ab93-d4d652644deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5af0931-b4a6-42d4-9626-779a24ee8920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:15 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Flow 'volume_create_manager' (603515b0-6264-4fec-913a-8f6cea9da9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc363c7-91d3-4b8f-8590-08c776009ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:15 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Flow 'volume_create_manager' (3438cbb4-8555-40d2-a390-006157807342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67056a4-c919-4bfe-9c78-a92230d84764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9d93136f-b794-4d65-acbc-3869d18b8c6a" returned: 0 in 0.644s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:15 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Volume volume-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070 (d7bcdfd8-a27a-4f7d-b84e-97cb8d879070): created successfully
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5af0931-b4a6-42d4-9626-779a24ee8920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:15 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Flow 'volume_create_manager' (b8c47ba6-00ca-4d27-a6a9-0a0d26a02b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] <== create_volume: return (1250ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.760s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1770609338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6579d00-180a-4cd9-854b-8329193e30bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50454317e4c24166b0d83f1155b40f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:13Z,use_quota=True,user_id='9b391dae95ae4706926d1b2c928d2fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Creating volume a6579d00-180a-4cd9-854b-8329193e30bf {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:37:16 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6579d00-180a-4cd9-854b-8329193e30bf 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:16 devstack quobyte-client[83360]: System call of process 99614 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:16 devstack quobyte-client[83360]: System call of process 99614 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc363c7-91d3-4b8f-8590-08c776009ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1784374149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50454317e4c24166b0d83f1155b40f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:14Z,use_quota=True,user_id='9b391dae95ae4706926d1b2c928d2fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:16 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=148, name=volume-a6579d00-180a-4cd9-854b-8329193e30bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429b5b30-6882-44b8-b191-abc3573074e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429b5b30-6882-44b8-b191-abc3573074e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a75eb9-9cfa-494e-a3c9-3c290f0fee36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a75eb9-9cfa-494e-a3c9-3c290f0fee36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8', 'volume_name': 'volume-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eeb07c9-fee9-46e7-bb26-34d52840cf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eeb07c9-fee9-46e7-bb26-34d52840cf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf8f1b7-9c89-4dab-b1a3-81e760140e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:16 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Volume 6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8', 'volume_size': 1}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67056a4-c919-4bfe-9c78-a92230d84764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1031392932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1004a4ba-3df1-435a-b833-b3129d7ceed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50454317e4c24166b0d83f1155b40f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:15Z,use_quota=True,user_id='9b391dae95ae4706926d1b2c928d2fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cace582-809a-4305-8196-95a9dc6f9a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cace582-809a-4305-8196-95a9dc6f9a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888c2399-6448-407d-81e5-8e123742b979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888c2399-6448-407d-81e5-8e123742b979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1004a4ba-3df1-435a-b833-b3129d7ceed2', 'volume_name': 'volume-1004a4ba-3df1-435a-b833-b3129d7ceed2', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad14728a-c126-432a-9beb-283def2155d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad14728a-c126-432a-9beb-283def2155d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd143301-3bae-42ad-88d3-c62d07c6bd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:16 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Volume 1004a4ba-3df1-435a-b833-b3129d7ceed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1004a4ba-3df1-435a-b833-b3129d7ceed2', 'volume_size': 1}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:16 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-f816730c-891c-4d8b-935e-307c80a79842 tempest-CreateVolumesFromImageTest-60037575 None] Created volume successfully.
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75f41f81-3c42-46cb-85c9-eab53cc06247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d93136f-b794-4d65-acbc-3869d18b8c6a', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69654b62-5bb7-4508-92fc-ab7c1ab9b923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6579d00-180a-4cd9-854b-8329193e30bf 1073741824" returned: 0 in 0.817s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6579d00-180a-4cd9-854b-8329193e30bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:17 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Flow 'volume_create_manager' (4bf30f6c-b881-410b-85ff-0d705732e151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85902ca-046b-4a98-8f1c-685784db61e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:17 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Volume volume-9d93136f-b794-4d65-acbc-3869d18b8c6a (9d93136f-b794-4d65-acbc-3869d18b8c6a): created successfully
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69654b62-5bb7-4508-92fc-ab7c1ab9b923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Flow 'volume_create_manager' (791d9a60-6635-4798-8883-21f032f9cc31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85902ca-046b-4a98-8f1c-685784db61e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c09925b-1065-4f04-af55-c7aeb64922f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d143de0a0b74a82b6ceea539e956852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:17Z,use_quota=True,user_id='49741341c6144753843eba4cd8be0960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67f684d-2332-49c1-8df9-a17001a7fe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67f684d-2332-49c1-8df9-a17001a7fe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfa58b8-2694-49f3-99c5-9025d3ee61cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6579d00-180a-4cd9-854b-8329193e30bf" returned: 0 in 0.646s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] <== create_volume: return (1491ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1784374149',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50454317e4c24166b0d83f1155b40f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:14Z,use_quota=True,user_id='9b391dae95ae4706926d1b2c928d2fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Creating volume 6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:37:17 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:17 devstack quobyte-client[83360]: System call of process 99618 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:17 devstack quobyte-client[83360]: System call of process 99618 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:17 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=149, name=volume-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (847ad364-391a-4e6f-876e-725451e70587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6579d00-180a-4cd9-854b-8329193e30bf', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:17 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d0c8fe-6a2b-4753-b4f5-8c724c44d856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:18 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-1a360108-6b35-4ca0-83dc-32f26b8f86e4 tempest-CreateVolumesFromImageTest-60037575 None] Created volume successfully.
Sep 18 22:37:18 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Volume volume-a6579d00-180a-4cd9-854b-8329193e30bf (a6579d00-180a-4cd9-854b-8329193e30bf): created successfully
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34d0c8fe-6a2b-4753-b4f5-8c724c44d856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Flow 'volume_create_manager' (11584c13-e3b1-4abb-b91d-911ff384a5b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8 1073741824" returned: 0 in 0.613s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:18 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-b3dc5da1-3a4c-41d3-a468-76544f770d68 tempest-CreateVolumesFromImageTest-60037575 None] Created volume successfully.
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8" returned: 0 in 0.467s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] <== create_volume: return (1113ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfa58b8-2694-49f3-99c5-9025d3ee61cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c09925b-1065-4f04-af55-c7aeb64922f7', 'volume_name': 'volume-6c09925b-1065-4f04-af55-c7aeb64922f7', 'volume_size': 1, 'image_id': '9c55ac70-e5f5-40bd-9d4a-484790755864', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c958fa4451246d13fb8c43bbf563647', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9d143de0a0b74a82b6ceea539e956852', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec35011c1a6482dc2de5ef322da1d1611d23e3d74d1d27c0b31c52eea0dc29145047404e41b82cbe85ddda68e4d38e8f91fbbae98866486a8ab4a05709c9995d', 'id': '9c55ac70-e5f5-40bd-9d4a-484790755864', 'created_at': datetime.datetime(2025, 9, 18, 20, 37, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 20, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c55ac70-e5f5-40bd-9d4a-484790755864/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9054553be0>}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76cdd127-711c-41b7-9bca-721be57f4213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76cdd127-711c-41b7-9bca-721be57f4213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3aa4529-e4b1-4159-b41a-21c062d60345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:18 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Volume 6c09925b-1065-4f04-af55-c7aeb64922f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c09925b-1065-4f04-af55-c7aeb64922f7', 'volume_size': 1, 'image_id': '9c55ac70-e5f5-40bd-9d4a-484790755864', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c958fa4451246d13fb8c43bbf563647', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9d143de0a0b74a82b6ceea539e956852', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec35011c1a6482dc2de5ef322da1d1611d23e3d74d1d27c0b31c52eea0dc29145047404e41b82cbe85ddda68e4d38e8f91fbbae98866486a8ab4a05709c9995d', 'id': '9c55ac70-e5f5-40bd-9d4a-484790755864', 'created_at': datetime.datetime(2025, 9, 18, 20, 37, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 20, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c55ac70-e5f5-40bd-9d4a-484790755864/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9054553be0>}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Cloning 6c09925b-1065-4f04-af55-c7aeb64922f7 from image 9c55ac70-e5f5-40bd-9d4a-484790755864  at location (None, None). {{(pid=83342) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.114s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1031392932',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1004a4ba-3df1-435a-b833-b3129d7ceed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50454317e4c24166b0d83f1155b40f89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:15Z,use_quota=True,user_id='9b391dae95ae4706926d1b2c928d2fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Creating volume 1004a4ba-3df1-435a-b833-b3129d7ceed2 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:37:18 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:37:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1004a4ba-3df1-435a-b833-b3129d7ceed2 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:18 devstack quobyte-client[83360]: System call of process 99622 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:18 devstack quobyte-client[83360]: System call of process 99622 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:19 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=150, name=volume-1004a4ba-3df1-435a-b833-b3129d7ceed2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf8f1b7-9c89-4dab-b1a3-81e760140e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef289d1e-21b6-4069-a73d-96e125b84fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:19 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Volume volume-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8 (6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8): created successfully
Sep 18 22:37:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef289d1e-21b6-4069-a73d-96e125b84fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Flow 'volume_create_manager' (603515b0-6264-4fec-913a-8f6cea9da9b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1004a4ba-3df1-435a-b833-b3129d7ceed2 1073741824" returned: 0 in 0.593s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1004a4ba-3df1-435a-b833-b3129d7ceed2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:19 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-d6aa1114-c177-41c7-aa25-d8abfb08498f tempest-CreateVolumesFromImageTest-60037575 None] Created volume successfully.
Sep 18 22:37:19 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 18 22:37:19 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Image download 0.00 MB at 0.00 MB/s
Sep 18 22:37:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1004a4ba-3df1-435a-b833-b3129d7ceed2" returned: 0 in 0.410s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:19 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] <== create_volume: return (1026ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:37:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd143301-3bae-42ad-88d3-c62d07c6bd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1004a4ba-3df1-435a-b833-b3129d7ceed2', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:19 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4b7919-bc5c-443e-980e-848a42ec2551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:19 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[06157d90-ef1b-4793-9651-c1ebcb45ce7d]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:37:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:20 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Volume volume-1004a4ba-3df1-435a-b833-b3129d7ceed2 (1004a4ba-3df1-435a-b833-b3129d7ceed2): created successfully
Sep 18 22:37:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4b7919-bc5c-443e-980e-848a42ec2551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:20 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Flow 'volume_create_manager' (3438cbb4-8555-40d2-a390-006157807342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:20 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-db5d49c3-aa90-4825-8340-6b965cd5febd tempest-CreateVolumesFromImageTest-60037575 None] Created volume successfully.
Sep 18 22:37:20 devstack sudo[99626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD
Sep 18 22:37:20 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:37:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "cinder-1004a4ba-3df1-435a-b833-b3129d7ceed2-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:37:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-1004a4ba-3df1-435a-b833-b3129d7ceed2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:37:21 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "cinder-quobyte-1004a4ba-3df1-435a-b833-b3129d7ceed2" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:37:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-quobyte-1004a4ba-3df1-435a-b833-b3129d7ceed2" acquired by "delete_volume" :: waited 0.010s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:37:21 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ace55a8-c9f9-4ce3-b681-f20461a84877]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:37:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1004a4ba-3df1-435a-b833-b3129d7ceed2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1004a4ba-3df1-435a-b833-b3129d7ceed2" returned: 0 in 0.989s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1004a4ba-3df1-435a-b833-b3129d7ceed2 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1004a4ba-3df1-435a-b833-b3129d7ceed2" returned: 0 in 0.216s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-quobyte-1004a4ba-3df1-435a-b833-b3129d7ceed2" released by "delete_volume" :: held 1.493s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:37:23 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Created reservations ['19a59649-0847-40c6-af2b-2728ff01b271', 'f8e036d8-f578-4aff-a694-cbafc6cf1e86', '62663160-f7d5-47b7-bcd6-c8089b446137', '757c6957-50ab-49ba-9e3e-3bf10544389e'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:37:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:23 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "cinder-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:37:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8-delete_volume" acquired by "delete_volume" :: waited 0.178s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:37:24 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root
Sep 18 22:37:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.698s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:24 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:37:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD" returned: 0 in 4.258s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:24 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Deleted volume successfully.
Sep 18 22:37:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:24 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b5809f17-9c24-4a61-8950-ff5c5a2f2232 tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-1004a4ba-3df1-435a-b833-b3129d7ceed2-delete_volume" released by "delete_volume" :: held 3.753s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:37:24 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:24 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "cinder-quobyte-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:37:24 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-quobyte-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8" acquired by "delete_volume" :: waited 0.023s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:37:24 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[339c841d-3e37-40d7-9485-50274c6440ca]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:37:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:25 devstack sudo[99636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD
Sep 18 22:37:25 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:37:25 devstack quobyte-client[83360]: System call of process 99637 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8" returned: 0 in 1.094s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8" returned: 0 in 0.157s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:26 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-quobyte-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8" released by "delete_volume" :: held 1.482s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:37:26 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Created reservations ['5f4ac532-998e-42fa-923a-f9535a26c781', 'a1bd5689-f1c6-48ee-803b-ffd357cedc1b', 'a63d6dab-ada6-44ba-b58d-90e9bf981945', 'd98f7f57-b6d2-4032-b5d4-4218c39b7ad8'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:37:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "cinder-a6579d00-180a-4cd9-854b-8329193e30bf-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:37:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.619s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:27 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:37:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-a6579d00-180a-4cd9-854b-8329193e30bf-delete_volume" acquired by "delete_volume" :: waited 0.326s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:37:27 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Deleted volume successfully.
Sep 18 22:37:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-cfe6efd8-e484-4795-917f-16219b4bd8e3 tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-6a7c1aa9-ef0e-4f3b-bc96-9b39193e51e8-delete_volume" released by "delete_volume" :: held 3.892s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:37:27 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "cinder-quobyte-a6579d00-180a-4cd9-854b-8329193e30bf" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:37:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-quobyte-a6579d00-180a-4cd9-854b-8329193e30bf" acquired by "delete_volume" :: waited 0.014s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:37:28 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root
Sep 18 22:37:28 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae547a66-4e32-4b9b-82a5-9d72e2f2504a]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:37:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6579d00-180a-4cd9-854b-8329193e30bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD" returned: 1 in 3.887s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:37:28 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Temporary image 9c55ac70-e5f5-40bd-9d4a-484790755864 is fetched for user 49741341c6144753843eba4cd8be0960. {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 18 22:37:28 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8dbd36-36ed-43a3-ac53-7e8e0fc980bd]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:37:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6579d00-180a-4cd9-854b-8329193e30bf" returned: 0 in 0.788s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6579d00-180a-4cd9-854b-8329193e30bf {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-a6579d00-180a-4cd9-854b-8329193e30bf" returned: 0 in 0.203s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-quobyte-a6579d00-180a-4cd9-854b-8329193e30bf" released by "delete_volume" :: held 1.276s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:37:29 devstack sudo[99648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD
Sep 18 22:37:29 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:37:29 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Created reservations ['3776619a-8c44-4855-a048-a8fa23e2d88e', 'b1befbd6-21e0-4eb1-a3d5-d8e2729259d3', '8c352836-c33e-4e32-88cc-de66c165016e', '49ab9896-52ef-4e7f-a905-bc5916feff71'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:37:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:29 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.181s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:30 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:37:30 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Deleted volume successfully.
Sep 18 22:37:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-498a9438-cbb1-4e58-876c-2731b07e48ca tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-a6579d00-180a-4cd9-854b-8329193e30bf-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:37:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "cinder-9d93136f-b794-4d65-acbc-3869d18b8c6a-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:37:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-9d93136f-b794-4d65-acbc-3869d18b8c6a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:37:30 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "cinder-quobyte-9d93136f-b794-4d65-acbc-3869d18b8c6a" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:37:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-quobyte-9d93136f-b794-4d65-acbc-3869d18b8c6a" acquired by "delete_volume" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:37:30 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb265521-3861-4c76-8466-3f3b36dcd576]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:37:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9d93136f-b794-4d65-acbc-3869d18b8c6a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:31 devstack quobyte-client[83360]: System call of process 99654 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:31 devstack quobyte-client[83360]: System call of process 99654 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:31 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root
Sep 18 22:37:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9d93136f-b794-4d65-acbc-3869d18b8c6a" returned: 0 in 0.959s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9d93136f-b794-4d65-acbc-3869d18b8c6a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD" returned: 0 in 3.411s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:32 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-9d93136f-b794-4d65-acbc-3869d18b8c6a" returned: 0 in 0.543s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-quobyte-9d93136f-b794-4d65-acbc-3869d18b8c6a" released by "delete_volume" :: held 1.871s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:37:33 devstack sudo[99676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD
Sep 18 22:37:33 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 18 22:37:33 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Created reservations ['a0bc8ec6-202e-415f-bcc7-5b665a196e91', '931da007-e03f-405d-b7c7-73013060031e', 'fb52c441-a750-4b97-8a83-a128cea8e1c7', 'c5c4fb00-d5e5-4858-9cb0-5ce8bdc4836f'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:37:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:33 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:33 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:33 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "cinder-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:37:34 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.676s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:34 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:37:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070-delete_volume" acquired by "delete_volume" :: waited 0.179s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:37:34 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Deleted volume successfully.
Sep 18 22:37:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bc97c537-a371-4a90-9ea0-62dc8e734c3d tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-9d93136f-b794-4d65-acbc-3869d18b8c6a-delete_volume" released by "delete_volume" :: held 4.178s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:37:34 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "cinder-quobyte-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:37:34 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-quobyte-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070" acquired by "delete_volume" :: waited 0.021s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:37:35 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3aa8f0-fbd4-4605-a12f-57dcd6cfbf8e]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:37:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070" returned: 0 in 0.787s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:35 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070" returned: 0 in 0.383s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-quobyte-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070" released by "delete_volume" :: held 1.335s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:37:36 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD" returned: 1 in 4.424s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c09925b-1065-4f04-af55-c7aeb64922f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d143de0a0b74a82b6ceea539e956852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:17Z,use_quota=True,user_id='49741341c6144753843eba4cd8be0960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Creating volume 6c09925b-1065-4f04-af55-c7aeb64922f7 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:37:36 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:36 devstack quobyte-client[83360]: System call of process 99709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:36 devstack quobyte-client[83360]: System call of process 99709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:36 devstack quobyte-client[83360]: System call of process 99709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:36 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Created reservations ['51f7d6ab-3acc-4cd8-b157-51ef1db7e0ec', 'ec9f149c-80f8-4638-96df-288851ff4e0a', 'b66934a1-85fb-499b-8bdf-86f013b6a2ef', 'ca3f636c-1ac9-4fb2-a1f2-dba8dbeb46b5'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:37:36 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=151, name=volume-6c09925b-1065-4f04-af55-c7aeb64922f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7 1073741824" returned: 0 in 0.493s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7" returned: 0 in 0.329s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] <== create_volume: return (864ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:37:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:37 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Attempting download of 9c55ac70-e5f5-40bd-9d4a-484790755864 ((None, None)) to volume 6c09925b-1065-4f04-af55-c7aeb64922f7. {{(pid=83342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Sep 18 22:37:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:38 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9463c2-e56a-47e8-8357-e7b0460fdebf]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:37:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c55ac70-e5f5-40bd-9d4a-484790755864_v2fi140l {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.459s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:38 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:37:38 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Deleted volume successfully.
Sep 18 22:37:38 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-11a9ecb7-59d1-4dfa-8e69-771c07f8f703 tempest-CreateVolumesFromImageTest-60037575 None] Lock "cinder-d7bcdfd8-a27a-4f7d-b84e-97cb8d879070-delete_volume" released by "delete_volume" :: held 4.056s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:37:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c55ac70-e5f5-40bd-9d4a-484790755864_v2fi140l" returned: 0 in 0.652s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c55ac70-e5f5-40bd-9d4a-484790755864_v2fi140l {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c55ac70-e5f5-40bd-9d4a-484790755864_v2fi140l" returned: 1 in 0.610s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c55ac70-e5f5-40bd-9d4a-484790755864_v2fi140l' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:37:39 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[19669cd0-ba09-42ae-b8a3-6753aa0aee92]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:37:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:37:40 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] 9c55ac70-e5f5-40bd-9d4a-484790755864 was raw, converting to raw {{(pid=83342) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 18 22:37:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:40 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=151, name=volume-6c09925b-1065-4f04-af55-c7aeb64922f7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7" returned: 0 in 0.258s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:40 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9c55ac70-e5f5-40bd-9d4a-484790755864_k41y5fcydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7 {{(pid=83342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 22:37:40 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Converted 0.00 MB image at 0.00 MB/s
Sep 18 22:37:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:41 devstack quobyte-client[83360]: System call of process 99726 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:41 devstack quobyte-client[83360]: System call of process 99726 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:41 devstack quobyte-client[83360]: System call of process 99726 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7 1G" returned: 0 in 0.286s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:41 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ac90c2-f372-4873-bd54-6cbf0be864bf]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:37:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:41 devstack quobyte-client[83360]: System call of process 99729 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7" returned: 0 in 0.533s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:42 devstack quobyte-client[83360]: System call of process 99731 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7" returned: 1 in 0.505s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:37:42 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Downloaded image 9c55ac70-e5f5-40bd-9d4a-484790755864 ((None, None)) to volume 6c09925b-1065-4f04-af55-c7aeb64922f7 successfully. {{(pid=83342) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Sep 18 22:37:42 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Temporary image 9c55ac70-e5f5-40bd-9d4a-484790755864 for user 49741341c6144753843eba4cd8be0960 is deleted. {{(pid=83342) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 18 22:37:42 devstack cinder-volume[83342]: DEBUG cinder.volume.volume_utils [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Marking volume 6c09925b-1065-4f04-af55-c7aeb64922f7 as bootable. {{(pid=83342) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Sep 18 22:37:42 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Copying metadata from image 9c55ac70-e5f5-40bd-9d4a-484790755864 to 6c09925b-1065-4f04-af55-c7aeb64922f7. {{(pid=83342) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 18 22:37:42 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Creating volume glance metadata for volume 6c09925b-1065-4f04-af55-c7aeb64922f7 backed by image 9c55ac70-e5f5-40bd-9d4a-484790755864 with: {'image_id': '9c55ac70-e5f5-40bd-9d4a-484790755864', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8c958fa4451246d13fb8c43bbf563647', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83342) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 18 22:37:42 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Flow 'volume_create_manager' (ffbb906e-f583-4a27-a18e-78b44cbd4205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5063dd-9688-42ef-85a3-f795daa3ce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5063dd-9688-42ef-85a3-f795daa3ce9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1948233639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cbdfe88-2748-4ea4-8b87-5e17789dfc4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059a1ec631f849cdb0b3f2d896bca585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:42Z,use_quota=True,user_id='867570c07c024d98bcf319c72ea1d12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b41c65-223e-4667-af5e-297b122cd995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b41c65-223e-4667-af5e-297b122cd995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbff08e-e9a9-4237-a8aa-24f6fe9df799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cbff08e-e9a9-4237-a8aa-24f6fe9df799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cbdfe88-2748-4ea4-8b87-5e17789dfc4b', 'volume_name': 'volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fee00b4-56ae-41b7-bcf7-dd0717bb4a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fee00b4-56ae-41b7-bcf7-dd0717bb4a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0dff93-e041-45c1-8720-0cea487b1a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:43 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume 7cbdfe88-2748-4ea4-8b87-5e17789dfc4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b', 'volume_size': 1}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1948233639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cbdfe88-2748-4ea4-8b87-5e17789dfc4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059a1ec631f849cdb0b3f2d896bca585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:42Z,use_quota=True,user_id='867570c07c024d98bcf319c72ea1d12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Creating volume 7cbdfe88-2748-4ea4-8b87-5e17789dfc4b {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:37:43 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:43 devstack quobyte-client[83360]: System call of process 99735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:43 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=152, name=volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3aa4529-e4b1-4159-b41a-21c062d60345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c09925b-1065-4f04-af55-c7aeb64922f7', 'volume_size': 1, 'image_id': '9c55ac70-e5f5-40bd-9d4a-484790755864', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8c958fa4451246d13fb8c43bbf563647', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9d143de0a0b74a82b6ceea539e956852', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec35011c1a6482dc2de5ef322da1d1611d23e3d74d1d27c0b31c52eea0dc29145047404e41b82cbe85ddda68e4d38e8f91fbbae98866486a8ab4a05709c9995d', 'id': '9c55ac70-e5f5-40bd-9d4a-484790755864', 'created_at': datetime.datetime(2025, 9, 18, 20, 37, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 18, 20, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c55ac70-e5f5-40bd-9d4a-484790755864/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f9054553be0>}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95371845-fb50-4509-b791-606475cfe58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:43 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Volume volume-6c09925b-1065-4f04-af55-c7aeb64922f7 (6c09925b-1065-4f04-af55-c7aeb64922f7): created successfully
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95371845-fb50-4509-b791-606475cfe58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Flow 'volume_create_manager' (4bf30f6c-b881-410b-85ff-0d705732e151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:43 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-fae8314a-1787-43bd-9306-b3e49e60f270 tempest-VolumeImageDependencyTests-1797878951 None] Created volume successfully.
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b 1073741824" returned: 0 in 0.589s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b" returned: 0 in 0.184s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] <== create_volume: return (850ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:37:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:44 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Acquiring lock "cinder-6c09925b-1065-4f04-af55-c7aeb64922f7-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:37:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a0dff93-e041-45c1-8720-0cea487b1a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd88faf4-f848-436c-8a1b-ed8352167a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:44 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b (7cbdfe88-2748-4ea4-8b87-5e17789dfc4b): created successfully
Sep 18 22:37:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd88faf4-f848-436c-8a1b-ed8352167a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Flow 'volume_create_manager' (ffbb906e-f583-4a27-a18e-78b44cbd4205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:44 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Lock "cinder-6c09925b-1065-4f04-af55-c7aeb64922f7-delete_volume" acquired by "delete_volume" :: waited 0.185s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:37:44 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a37111d0-4e04-4982-a7f7-62fa69f627cb tempest-CreateVolumesFromSnapshotTest-66960798 None] Created volume successfully.
Sep 18 22:37:44 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:44 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Acquiring lock "cinder-quobyte-6c09925b-1065-4f04-af55-c7aeb64922f7" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:37:44 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Lock "cinder-quobyte-6c09925b-1065-4f04-af55-c7aeb64922f7" acquired by "delete_volume" :: waited 0.017s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:37:44 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d02096-14c8-4964-92f6-72949456931e]: (4, 'raw') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:37:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:45 devstack quobyte-client[83360]: System call of process 99739 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7" returned: 0 in 0.661s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:45 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:45 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] Creating offline snapshot 4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7 of volume 7cbdfe88-2748-4ea4-8b87-5e17789dfc4b {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:37:45 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb208974-6187-437a-aa96-3fe6e3cdf3e2]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:37:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:45 devstack quobyte-client[83360]: System call of process 99741 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7" returned: 1 in 0.630s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7' failed. Not Retrying. {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 18 22:37:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6c09925b-1065-4f04-af55-c7aeb64922f7" returned: 0 in 0.158s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Lock "cinder-quobyte-6c09925b-1065-4f04-af55-c7aeb64922f7" released by "delete_volume" :: held 1.733s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:37:46 devstack quobyte-client[83360]: System call of process 99742 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:46 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Created reservations ['9fbac50b-731d-4a6c-9be8-da08576902e2', '294bb0ad-a20f-45fe-ba89-3e524e4b736e', '98f6caa6-d7cc-4eaf-bbd8-ee0fd79b67c5', 'ec235a0b-c51b-4412-ac4f-29a82505f626'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:37:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b" returned: 0 in 0.901s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:46 devstack quobyte-client[83360]: System call of process 99748 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:47 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=153, name=volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:47 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:37:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7 1G" returned: 0 in 0.751s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:47 devstack quobyte-client[83360]: System call of process 99752 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.542s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:37:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "qemu-img rebase -u -b volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7" returned: 0 in 0.406s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:37:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.049s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7" returned: 0 in 0.481s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:48 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:37:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.684s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:48 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:37:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7" returned: 0 in 0.475s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:48 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Deleted volume successfully.
Sep 18 22:37:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:49 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Flow 'volume_create_manager' (e613e884-dd0c-41e4-9b54-dd112a71fc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de76c46-b368-4f1d-a71c-de7375fe8975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de76c46-b368-4f1d-a71c-de7375fe8975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1096348550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7c6a92-7f5e-4d90-b449-21c1752075c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08dc4173e9a4f14b13882f393d57395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:48Z,use_quota=True,user_id='09f90837a97045a0a372c3102397014b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a99753d-f552-4126-afe3-3325f14c0204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a99753d-f552-4126-afe3-3325f14c0204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab209b0a-6b54-4989-bbc9-563455e0da62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab209b0a-6b54-4989-bbc9-563455e0da62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee7c6a92-7f5e-4d90-b449-21c1752075c8', 'volume_name': 'volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297557e8-9640-4ae1-a311-9583ef342733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297557e8-9640-4ae1-a311-9583ef342733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94040996-a4be-4018-ae33-e69adb84274d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:49 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Volume ee7c6a92-7f5e-4d90-b449-21c1752075c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8', 'volume_size': 1}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.info" returned: 0 in 0.629s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-a86d899f-bd27-4c4c-9238-02bad6b3e17c tempest-VolumeImageDependencyTests-1797878951 None] Lock "cinder-6c09925b-1065-4f04-af55-c7aeb64922f7-delete_volume" released by "delete_volume" :: held 5.270s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.info" returned: 0 in 0.207s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.255s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.420s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1096348550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7c6a92-7f5e-4d90-b449-21c1752075c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08dc4173e9a4f14b13882f393d57395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:48Z,use_quota=True,user_id='09f90837a97045a0a372c3102397014b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Creating volume ee7c6a92-7f5e-4d90-b449-21c1752075c8 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:37:50 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:50 devstack quobyte-client[83360]: System call of process 99760 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:50 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=155, name=volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:50 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-07e3e9af-f504-4e58-b28d-7ff37a03b7be tempest-CreateVolumesFromSnapshotTest-66960798 None] Create snapshot completed successfully
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 1073741824" returned: 0 in 0.478s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8" returned: 0 in 0.107s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] <== create_volume: return (642ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94040996-a4be-4018-ae33-e69adb84274d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763c0c8a-6eba-4cea-b74c-5773f606277e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:50 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Volume volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 (ee7c6a92-7f5e-4d90-b449-21c1752075c8): created successfully
Sep 18 22:37:50 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763c0c8a-6eba-4cea-b74c-5773f606277e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Flow 'volume_create_manager' (e613e884-dd0c-41e4-9b54-dd112a71fc46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:51 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-34d9e819-769e-4a5d-8be0-b0c25e0380d7 tempest-SnapshotDependencyTests-1178615668 None] Created volume successfully.
Sep 18 22:37:51 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:51 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:37:51 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Flow 'volume_create_manager' (44c78726-b44d-4915-b22d-015b5ff0c7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c988c1-dc7c-4d93-a39a-fd0817965716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c988c1-dc7c-4d93-a39a-fd0817965716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c16816-4581-48bc-ba51-d002ae748d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e82c8fb303c4c9bbf1be584d35d8640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:52Z,use_quota=True,user_id='086237f36c1b4ae59b25331242bba6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2792dedb-8d13-4cc3-9153-826919d5ad36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2792dedb-8d13-4cc3-9153-826919d5ad36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392e4e63-6b0d-4ec4-91b1-d3374c0edbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392e4e63-6b0d-4ec4-91b1-d3374c0edbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02c16816-4581-48bc-ba51-d002ae748d3e', 'volume_name': 'volume-02c16816-4581-48bc-ba51-d002ae748d3e', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ec974b-884c-4ec1-a44a-81bc8dce091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ec974b-884c-4ec1-a44a-81bc8dce091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa80847-5227-423c-ab79-b59d262d5d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:52 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Volume 02c16816-4581-48bc-ba51-d002ae748d3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02c16816-4581-48bc-ba51-d002ae748d3e', 'volume_size': 1}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c16816-4581-48bc-ba51-d002ae748d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e82c8fb303c4c9bbf1be584d35d8640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:52Z,use_quota=True,user_id='086237f36c1b4ae59b25331242bba6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Creating volume 02c16816-4581-48bc-ba51-d002ae748d3e {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:37:52 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-02c16816-4581-48bc-ba51-d002ae748d3e 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:52 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:37:52 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=156, name=volume-02c16816-4581-48bc-ba51-d002ae748d3e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Flow 'volume_create_manager' (b45fbdaa-2567-498b-941c-3e154d5dd7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeae7a8b-d682-4055-8624-c86dff2a4dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeae7a8b-d682-4055-8624-c86dff2a4dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548767369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059a1ec631f849cdb0b3f2d896bca585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:52Z,use_quota=True,user_id='867570c07c024d98bcf319c72ea1d12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6df7ed-9126-466f-a3d2-417d61da5445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6df7ed-9126-466f-a3d2-417d61da5445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c1bb87-6337-40b0-b04a-3be35a4ba1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c1bb87-6337-40b0-b04a-3be35a4ba1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811', 'volume_name': 'volume-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2b2010-c5bc-496b-ac70-667bfce45b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf2b2010-c5bc-496b-ac70-667bfce45b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f4e0a0-9859-4627-b574-edf293aaea71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:52 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume 4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811', 'volume_size': 1}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-02c16816-4581-48bc-ba51-d002ae748d3e 1073741824" returned: 0 in 0.687s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-02c16816-4581-48bc-ba51-d002ae748d3e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:53 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Flow 'volume_create_manager' (51493aa4-94e7-4837-b6ea-ad3bd5f7bae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1474e12-84e2-44c8-8811-64b77966c224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:53 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-02c16816-4581-48bc-ba51-d002ae748d3e" returned: 0 in 0.544s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1474e12-84e2-44c8-8811-64b77966c224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1568031789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe1b752-7295-4747-93ba-57bad63a1156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059a1ec631f849cdb0b3f2d896bca585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:52Z,use_quota=True,user_id='867570c07c024d98bcf319c72ea1d12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c7f2b8-eb78-47fb-9626-75243ec19175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44c7f2b8-eb78-47fb-9626-75243ec19175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcfd3757-c7f6-4c2d-af9a-ad5a9a5647bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcfd3757-c7f6-4c2d-af9a-ad5a9a5647bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe1b752-7295-4747-93ba-57bad63a1156', 'volume_name': 'volume-abe1b752-7295-4747-93ba-57bad63a1156', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78847b3f-7580-48c8-836d-f07347c2528c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78847b3f-7580-48c8-836d-f07347c2528c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82601f4-fc5f-4c0a-92b4-c72c093d96bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:53 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume abe1b752-7295-4747-93ba-57bad63a1156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe1b752-7295-4747-93ba-57bad63a1156', 'volume_size': 1}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] <== create_volume: return (1314ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548767369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059a1ec631f849cdb0b3f2d896bca585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:52Z,use_quota=True,user_id='867570c07c024d98bcf319c72ea1d12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Creating volume 4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:37:53 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:53 devstack quobyte-client[83360]: System call of process 99770 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:53 devstack quobyte-client[83360]: System call of process 99770 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:53 devstack quobyte-client[83360]: System call of process 99770 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:53 devstack quobyte-client[83360]: System call of process 99770 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:53 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=157, name=volume-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa80847-5227-423c-ab79-b59d262d5d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c16816-4581-48bc-ba51-d002ae748d3e', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:53 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56eee72-9d5c-4582-aa0c-0b984a754edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Flow 'volume_create_manager' (0fc2cea3-3f01-4823-8d58-c90a1c2fbe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc05ab8-1faf-47fc-a8ee-8b2d27b39587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc05ab8-1faf-47fc-a8ee-8b2d27b39587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1922853167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f26563-5e81-4a7d-ad6e-8d4a98f16257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059a1ec631f849cdb0b3f2d896bca585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:53Z,use_quota=True,user_id='867570c07c024d98bcf319c72ea1d12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bc6bb6-9a97-49d6-83c8-d1c029f5a408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4bc6bb6-9a97-49d6-83c8-d1c029f5a408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d4f73c6-c4fe-4fde-a3f5-19ad54cc24c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d4f73c6-c4fe-4fde-a3f5-19ad54cc24c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f26563-5e81-4a7d-ad6e-8d4a98f16257', 'volume_name': 'volume-84f26563-5e81-4a7d-ad6e-8d4a98f16257', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8db2f06-9819-47b2-afe7-fa955e3abd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8db2f06-9819-47b2-afe7-fa955e3abd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ff05f5-beb6-4b6b-8476-f46d5d3c09bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume 84f26563-5e81-4a7d-ad6e-8d4a98f16257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f26563-5e81-4a7d-ad6e-8d4a98f16257', 'volume_size': 1}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:54 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Volume volume-02c16816-4581-48bc-ba51-d002ae748d3e (02c16816-4581-48bc-ba51-d002ae748d3e): created successfully
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56eee72-9d5c-4582-aa0c-0b984a754edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Flow 'volume_create_manager' (44c78726-b44d-4915-b22d-015b5ff0c7b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811 1073741824" returned: 0 in 0.728s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:54 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Flow 'volume_create_manager' (f014045c-c25e-4d07-9f8a-678c1af4657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3300236-82e1-41e4-9cb1-cf448b2c111e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-e046fdab-b7bb-4ee6-9f6e-32173a9c8239 tempest-CinderUnicodeTest-775395927 None] Created volume successfully.
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3300236-82e1-41e4-9cb1-cf448b2c111e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1699086933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c59d2d8-bca9-44fd-acdf-f9aaa077c08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059a1ec631f849cdb0b3f2d896bca585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:53Z,use_quota=True,user_id='867570c07c024d98bcf319c72ea1d12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add42abb-a165-41dd-a161-5ae1532d51ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add42abb-a165-41dd-a161-5ae1532d51ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32133cdb-49bf-47a3-98c2-71275a6d2cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32133cdb-49bf-47a3-98c2-71275a6d2cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c59d2d8-bca9-44fd-acdf-f9aaa077c08a', 'volume_name': 'volume-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a69d56b-039d-467e-a5f9-3bed26c8b6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a69d56b-039d-467e-a5f9-3bed26c8b6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc9644d-d71f-4e21-90fc-abe7bede7f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume 5c59d2d8-bca9-44fd-acdf-f9aaa077c08a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a', 'volume_size': 1}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:54 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Flow 'volume_create_manager' (639453d4-7308-4676-8724-8ede3172ff6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca167edb-fb04-40b3-826d-39f6b750ec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811" returned: 0 in 0.515s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] <== create_volume: return (1272ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.495s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca167edb-fb04-40b3-826d-39f6b750ec2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1501156940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8562270-5cf8-44b9-8b40-91162e46fee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059a1ec631f849cdb0b3f2d896bca585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:54Z,use_quota=True,user_id='867570c07c024d98bcf319c72ea1d12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbcba827-100b-4d12-9962-3fa026c887d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbcba827-100b-4d12-9962-3fa026c887d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2b0748-941b-4b3a-8183-3dc3f70017eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2b0748-941b-4b3a-8183-3dc3f70017eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8562270-5cf8-44b9-8b40-91162e46fee7', 'volume_name': 'volume-c8562270-5cf8-44b9-8b40-91162e46fee7', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8796894b-96e3-4b45-8175-800110203a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8796894b-96e3-4b45-8175-800110203a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1adb134-2620-474b-b4cd-7c5160763473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume c8562270-5cf8-44b9-8b40-91162e46fee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8562270-5cf8-44b9-8b40-91162e46fee7', 'volume_size': 1}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f4e0a0-9859-4627-b574-edf293aaea71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92fd2f2-46b2-4b64-8aef-1141dec8b876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] Creating offline snapshot 795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9 of volume ee7c6a92-7f5e-4d90-b449-21c1752075c8 {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[666e1c03-567c-4991-b8e0-13df2cfdfdbb]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:37:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:55 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume volume-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811 (4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811): created successfully
Sep 18 22:37:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92fd2f2-46b2-4b64-8aef-1141dec8b876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:55 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Flow 'volume_create_manager' (b45fbdaa-2567-498b-941c-3e154d5dd7e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:55 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-cb89ef5b-992c-4e14-8462-929e2461cf69 tempest-CreateVolumesFromSnapshotTest-66960798 None] Created volume successfully.
Sep 18 22:37:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8" returned: 0 in 0.609s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:55 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=158, name=volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9 1G" returned: 0 in 0.523s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:56 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Flow 'volume_create_manager' (59ab06b2-d7ae-4fe8-b4a7-195c7c38e50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc25ac2-4499-40f0-bb11-04e2b6aef9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] CMD "qemu-img rebase -u -b volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9" returned: 0 in 0.438s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc25ac2-4499-40f0-bb11-04e2b6aef9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1487192369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7c2db6-b4fc-4116-80e2-984cd5592aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e82c8fb303c4c9bbf1be584d35d8640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:56Z,use_quota=True,user_id='086237f36c1b4ae59b25331242bba6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034d9181-169a-4a13-b2f9-decd248bb859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034d9181-169a-4a13-b2f9-decd248bb859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe89e6a6-a694-4b7c-b081-7a9c4a1f6020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe89e6a6-a694-4b7c-b081-7a9c4a1f6020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b7c2db6-b4fc-4116-80e2-984cd5592aa6', 'volume_name': 'volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0b1e91-a8e2-4703-98ec-7f114bb3533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0b1e91-a8e2-4703-98ec-7f114bb3533f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f68367c-525a-49e4-ab67-847769790481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:56 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Volume 7b7c2db6-b4fc-4116-80e2-984cd5592aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6', 'volume_size': 1}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9 is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9" returned: 0 in 0.114s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9" returned: 0 in 0.118s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.info" returned: 0 in 0.090s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:37:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.info" returned: 0 in 0.084s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.331s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.774s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1568031789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe1b752-7295-4747-93ba-57bad63a1156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059a1ec631f849cdb0b3f2d896bca585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:52Z,use_quota=True,user_id='867570c07c024d98bcf319c72ea1d12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Creating volume abe1b752-7295-4747-93ba-57bad63a1156 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:37:57 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-abe1b752-7295-4747-93ba-57bad63a1156 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:57 devstack quobyte-client[83360]: System call of process 99787 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:57 devstack quobyte-client[83360]: System call of process 99787 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:57 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=160, name=volume-abe1b752-7295-4747-93ba-57bad63a1156, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:57 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-91507e51-39b7-4eff-9b7a-e564f26ce516 tempest-SnapshotDependencyTests-1178615668 None] Create snapshot completed successfully
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-abe1b752-7295-4747-93ba-57bad63a1156 1073741824" returned: 0 in 0.458s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-abe1b752-7295-4747-93ba-57bad63a1156 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-abe1b752-7295-4747-93ba-57bad63a1156" returned: 0 in 0.138s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] <== create_volume: return (641ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.794s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1922853167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f26563-5e81-4a7d-ad6e-8d4a98f16257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059a1ec631f849cdb0b3f2d896bca585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:53Z,use_quota=True,user_id='867570c07c024d98bcf319c72ea1d12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Creating volume 84f26563-5e81-4a7d-ad6e-8d4a98f16257 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:37:58 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-84f26563-5e81-4a7d-ad6e-8d4a98f16257 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:58 devstack quobyte-client[83360]: System call of process 99791 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:58 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=161, name=volume-84f26563-5e81-4a7d-ad6e-8d4a98f16257, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f82601f4-fc5f-4c0a-92b4-c72c093d96bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe1b752-7295-4747-93ba-57bad63a1156', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7ca2d7-4247-40d9-aa4a-98dce757740d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:58 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume volume-abe1b752-7295-4747-93ba-57bad63a1156 (abe1b752-7295-4747-93ba-57bad63a1156): created successfully
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7ca2d7-4247-40d9-aa4a-98dce757740d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Flow 'volume_create_manager' (51493aa4-94e7-4837-b6ea-ad3bd5f7bae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-84f26563-5e81-4a7d-ad6e-8d4a98f16257 1073741824" returned: 0 in 0.421s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-84f26563-5e81-4a7d-ad6e-8d4a98f16257 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:58 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-ffe50641-021f-48e6-90a3-2cb701976d34 tempest-CreateVolumesFromSnapshotTest-66960798 None] Created volume successfully.
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-84f26563-5e81-4a7d-ad6e-8d4a98f16257" returned: 0 in 0.305s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] <== create_volume: return (756ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.082s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1699086933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c59d2d8-bca9-44fd-acdf-f9aaa077c08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059a1ec631f849cdb0b3f2d896bca585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:53Z,use_quota=True,user_id='867570c07c024d98bcf319c72ea1d12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Creating volume 5c59d2d8-bca9-44fd-acdf-f9aaa077c08a {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:37:58 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:37:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:58 devstack quobyte-client[83360]: System call of process 99795 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:59 devstack quobyte-client[83360]: System call of process 99795 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:59 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=162, name=volume-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ff05f5-beb6-4b6b-8476-f46d5d3c09bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f26563-5e81-4a7d-ad6e-8d4a98f16257', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c7ff19-fefd-44c5-a6a4-7ff46dbd2e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a 1073741824" returned: 0 in 0.471s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:59 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume volume-84f26563-5e81-4a7d-ad6e-8d4a98f16257 (84f26563-5e81-4a7d-ad6e-8d4a98f16257): created successfully
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c7ff19-fefd-44c5-a6a4-7ff46dbd2e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Flow 'volume_create_manager' (0fc2cea3-3f01-4823-8d58-c90a1c2fbe70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:37:59 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-48b5ace7-4ae5-478e-8833-884f0697712b tempest-CreateVolumesFromSnapshotTest-66960798 None] Created volume successfully.
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a" returned: 0 in 0.486s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] <== create_volume: return (988ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.007s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1501156940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8562270-5cf8-44b9-8b40-91162e46fee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='059a1ec631f849cdb0b3f2d896bca585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:54Z,use_quota=True,user_id='867570c07c024d98bcf319c72ea1d12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Creating volume c8562270-5cf8-44b9-8b40-91162e46fee7 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:37:59 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:37:59 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c8562270-5cf8-44b9-8b40-91162e46fee7 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:37:59 devstack quobyte-client[83360]: System call of process 99799 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:59 devstack quobyte-client[83360]: System call of process 99799 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:37:59 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=163, name=volume-c8562270-5cf8-44b9-8b40-91162e46fee7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:38:00 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc9644d-d71f-4e21-90fc-abe7bede7f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97c5106-41d4-4f50-956b-f82d7495be58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c8562270-5cf8-44b9-8b40-91162e46fee7 1073741824" returned: 0 in 0.511s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c8562270-5cf8-44b9-8b40-91162e46fee7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Flow 'volume_create_manager' (cb66d584-3887-47fc-9a9e-452af6bca9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fad803f-005c-4ee6-a186-4b243b73f21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fad803f-005c-4ee6-a186-4b243b73f21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f178761-400a-4cd9-9b6f-63a5c3ee712b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a08dc4173e9a4f14b13882f393d57395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:59Z,use_quota=True,user_id='09f90837a97045a0a372c3102397014b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d5dbf6-6832-48cb-bd73-57241a4cf834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d5dbf6-6832-48cb-bd73-57241a4cf834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b6ac4e-c2e8-49f6-96fb-3e9e4226a201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b6ac4e-c2e8-49f6-96fb-3e9e4226a201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f178761-400a-4cd9-9b6f-63a5c3ee712b', 'volume_name': 'volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b', 'volume_size': 1, 'snapshot_id': '795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9'}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d028f701-ebc6-4992-ae76-cc3461706450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d028f701-ebc6-4992-ae76-cc3461706450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160754be-e29c-4c03-8106-c35bc30950ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:00 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Volume 2f178761-400a-4cd9-9b6f-63a5c3ee712b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b', 'volume_size': 1, 'snapshot_id': '795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9'}
Sep 18 22:38:00 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume volume-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a (5c59d2d8-bca9-44fd-acdf-f9aaa077c08a): created successfully
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c97c5106-41d4-4f50-956b-f82d7495be58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Flow 'volume_create_manager' (f014045c-c25e-4d07-9f8a-678c1af4657c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c8562270-5cf8-44b9-8b40-91162e46fee7" returned: 0 in 0.585s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] <== create_volume: return (1125ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.445s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:37:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1487192369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7c2db6-b4fc-4116-80e2-984cd5592aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e82c8fb303c4c9bbf1be584d35d8640',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:37:56Z,use_quota=True,user_id='086237f36c1b4ae59b25331242bba6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Creating volume 7b7c2db6-b4fc-4116-80e2-984cd5592aa6 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:38:00 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:38:00 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:01 devstack quobyte-client[83360]: System call of process 99803 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:01 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=164, name=volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:38:01 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-305b35fc-d608-4cc4-b259-b3ea8259c1ae tempest-CreateVolumesFromSnapshotTest-66960798 None] Created volume successfully.
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1adb134-2620-474b-b4cd-7c5160763473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8562270-5cf8-44b9-8b40-91162e46fee7', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926381f9-384b-445a-b9a0-f0b3ae1cefd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6 1073741824" returned: 0 in 0.463s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:01 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume volume-c8562270-5cf8-44b9-8b40-91162e46fee7 (c8562270-5cf8-44b9-8b40-91162e46fee7): created successfully
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (926381f9-384b-445a-b9a0-f0b3ae1cefd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Flow 'volume_create_manager' (639453d4-7308-4676-8724-8ede3172ff6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6" returned: 0 in 0.350s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] <== create_volume: return (838ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.723s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "cinder-quobyte-795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9-2f178761-400a-4cd9-9b6f-63a5c3ee712b" by "_create_volume_from_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:01 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-b7acf450-2857-4a28-b605-7c85565862a7 tempest-CreateVolumesFromSnapshotTest-66960798 None] Created volume successfully.
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-quobyte-795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9-2f178761-400a-4cd9-9b6f-63a5c3ee712b" acquired by "_create_volume_from_snapshot" :: waited 0.089s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Creating volume 2f178761-400a-4cd9-9b6f-63a5c3ee712b from snapshot 795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9 {{(pid=83342) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "cinder-quobyte-2f178761-400a-4cd9-9b6f-63a5c3ee712b" by "_copy_volume_from_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f68367c-525a-49e4-ab67-847769790481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e11843-3617-4ea7-854e-795d32520b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-quobyte-2f178761-400a-4cd9-9b6f-63a5c3ee712b" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:01 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] snapshot: 795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9, volume: 2f178761-400a-4cd9-9b6f-63a5c3ee712b,  {{(pid=83342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:02 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Volume volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6 (7b7c2db6-b4fc-4116-80e2-984cd5592aa6): created successfully
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88e11843-3617-4ea7-854e-795d32520b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Flow 'volume_create_manager' (59ab06b2-d7ae-4fe8-b4a7-195c7c38e50a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "cinder-c8562270-5cf8-44b9-8b40-91162e46fee7-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2263899-4677-46ac-b561-30e8e605dd11]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:02 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-4876f42e-55a9-4d23-84fd-95bbf6fa68d3 tempest-CinderUnicodeTest-775395927 None] Created volume successfully.
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-c8562270-5cf8-44b9-8b40-91162e46fee7-delete_volume" acquired by "delete_volume" :: waited 0.442s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:02 devstack quobyte-client[83360]: System call of process 99810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:02 devstack quobyte-client[83360]: System call of process 99810 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:02 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "cinder-quobyte-c8562270-5cf8-44b9-8b40-91162e46fee7" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9" returned: 0 in 0.711s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 {{(pid=83342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Creating direct copy from snapshot {{(pid=83342) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-c8562270-5cf8-44b9-8b40-91162e46fee7" acquired by "delete_volume" :: waited 0.049s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:02 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5eb9449-1010-46d9-a91f-7945f4718bd0]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5e9f07-e4bb-4745-9b96-1787a016cd69]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:02 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c8562270-5cf8-44b9-8b40-91162e46fee7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8" returned: 0 in 0.493s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:03 devstack cinder-volume[83342]: DEBUG cinder.utils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b not found in is_blk_device check {{(pid=83342) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 18 22:38:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:03 devstack quobyte-client[83360]: System call of process 99814 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c8562270-5cf8-44b9-8b40-91162e46fee7" returned: 0 in 0.587s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:03 devstack quobyte-client[83360]: System call of process 99818 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:03 devstack quobyte-client[83360]: System call of process 99818 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c8562270-5cf8-44b9-8b40-91162e46fee7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:03 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=165, name=volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:38:03 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c8562270-5cf8-44b9-8b40-91162e46fee7" returned: 0 in 0.138s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:03 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-c8562270-5cf8-44b9-8b40-91162e46fee7" released by "delete_volume" :: held 1.053s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:04 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:UPDATE=86,cinder:SELECT=58,cinder:DELETE=11,cinder:INSERT=16 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:38:04 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=59,cinder:UPDATE=81,cinder:DELETE=12,cinder:INSERT=17 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:38:05 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Created reservations ['8d7ad863-0c9a-4760-9fdf-0e524bfcaed0', 'cbf3b85b-9e19-4539-9c45-0182f07f4d39', 'af561423-7b3a-4068-b0ad-cab4b23a4a0a', '8d2cbdf5-e51b-4231-a431-a88c7ac78e82'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:06 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:06 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "cinder-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:08 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 1.928s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:08 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:08 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a-delete_volume" acquired by "delete_volume" :: waited 0.811s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:09 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Deleted volume successfully.
Sep 18 22:38:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-3cfbba73-b477-42c7-9f2b-7795fd3b95b4 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-c8562270-5cf8-44b9-8b40-91162e46fee7-delete_volume" released by "delete_volume" :: held 6.729s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b" returned: 0 in 5.859s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:09 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f84e46-a2a6-4e8b-bd2c-67081e7691e7]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:09 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "cinder-quobyte-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:09 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a" acquired by "delete_volume" :: waited 0.094s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:09 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a022bd22-cde7-454b-9e6b-6e710cece787]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:09 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8" returned: 0 in 0.868s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:10 devstack cinder-volume[83342]: DEBUG cinder.image.image_utils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Image conversion details: src /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b {{(pid=83342) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 18 22:38:10 devstack cinder-volume[83342]: INFO cinder.image.image_utils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Converted 1024.00 MB image at 174.68 MB/s
Sep 18 22:38:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:38:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b" returned: 0 in 0.113s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a" returned: 0 in 0.602s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:10 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-quobyte-2f178761-400a-4cd9-9b6f-63a5c3ee712b" released by "_copy_volume_from_snapshot" :: held 8.687s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:10 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-quobyte-795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9-2f178761-400a-4cd9-9b6f-63a5c3ee712b" released by "_create_volume_from_snapshot" :: held 8.837s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.942s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.954s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:10 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a" returned: 0 in 0.376s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:10 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] Creating offline snapshot 999dcb00-3199-460c-856a-b44b51f3f8ca of volume 7b7c2db6-b4fc-4116-80e2-984cd5592aa6 {{(pid=83342) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 18 22:38:11 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a" released by "delete_volume" :: held 1.189s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:11 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf07eab-8b12-44e0-91d6-e9bdae51d471]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160754be-e29c-4c03-8106-c35bc30950ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b', 'volume_size': 1, 'snapshot_id': '795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9'}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b204e00-523b-4ecd-a018-f4d01ac47079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:11 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Volume volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b (2f178761-400a-4cd9-9b6f-63a5c3ee712b): created successfully
Sep 18 22:38:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b204e00-523b-4ecd-a018-f4d01ac47079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:11 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Flow 'volume_create_manager' (cb66d584-3887-47fc-9a9e-452af6bca9bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:11 devstack quobyte-client[83360]: System call of process 99840 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:11 devstack quobyte-client[83360]: System call of process 99840 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:11 devstack quobyte-client[83360]: System call of process 99840 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:11 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-19defaf5-f78a-456d-98f7-40a3df82bd52 tempest-SnapshotDependencyTests-1178615668 None] Created volume successfully.
Sep 18 22:38:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6" returned: 0 in 0.624s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:11 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca 1G {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:11 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Created reservations ['8d2df793-df1e-4e1f-ac24-aced15b467aa', 'ec809de7-5f18-402c-8f34-ca637b3d7e1e', 'fcefde04-786f-41ea-84b4-72f9d8311bac', '29fccbc3-cbaf-48b5-a9fa-fdf06cceeee9'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:11 devstack quobyte-client[83360]: System call of process 99843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:11 devstack quobyte-client[83360]: System call of process 99843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:11 devstack quobyte-client[83360]: System call of process 99843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:11 devstack quobyte-client[83360]: System call of process 99843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:11 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=166, name=volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:38:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca 1G" returned: 0 in 0.452s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:12 devstack quobyte-client[83360]: System call of process 99847 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "cinder-795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] CMD "qemu-img rebase -u -b volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6 -F qcow2 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca" returned: 0 in 0.430s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:38:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.359s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:12 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:12 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "cinder-quobyte-ee7c6a92-7f5e-4d90-b449-21c1752075c8" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca" returned: 0 in 0.341s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:12 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] Setting permissions: /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6 -> 1000:1000 {{(pid=83342) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 18 22:38:12 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "cinder-84f26563-5e81-4a7d-ad6e-8d4a98f16257-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-quobyte-ee7c6a92-7f5e-4d90-b449-21c1752075c8" acquired by "delete_snapshot" :: waited 0.609s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "cinder-quobyte-795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca" returned: 0 in 0.589s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.519s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:13 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Deleted volume successfully.
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-84f26563-5e81-4a7d-ad6e-8d4a98f16257-delete_volume" acquired by "delete_volume" :: waited 0.472s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-quobyte-795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9" acquired by "_delete_snapshot" :: waited 0.422s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Deleting offline snapshot 795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9 of volume ee7c6a92-7f5e-4d90-b449-21c1752075c8 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] snapshot_file for this snap is: volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd31098a-b012-44ad-9392-f9146b7a71fc]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.info" returned: 0 in 0.438s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:13 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] File path /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.info is being set with permissions: 660 {{(pid=83342) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 18 22:38:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.info {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-683368ce-749b-4fd3-aef9-c1e72e6d1b4b tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-5c59d2d8-bca9-44fd-acdf-f9aaa077c08a-delete_volume" released by "delete_volume" :: held 5.678s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.info" returned: 0 in 0.479s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.712s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:14 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:14 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "cinder-quobyte-84f26563-5e81-4a7d-ad6e-8d4a98f16257" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9" returned: 0 in 0.697s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:14 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:38:14 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e37fbb-f664-4900-90c5-053e85cf1448]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:14 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:15 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-84f26563-5e81-4a7d-ad6e-8d4a98f16257" acquired by "delete_volume" :: waited 0.335s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:15 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-2173a483-e2ee-4a0b-90dc-c40ffbc1c83c tempest-CinderUnicodeTest-775395927 None] Create snapshot completed successfully
Sep 18 22:38:15 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d684e5e-bcb9-44ef-a4b3-d46856329faa]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-84f26563-5e81-4a7d-ad6e-8d4a98f16257 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8" returned: 0 in 0.680s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:15 devstack quobyte-client[83360]: System call of process 99862 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9" returned: 0 in 0.272s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:15 devstack quobyte-client[83360]: System call of process 99859 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:15 devstack quobyte-client[83360]: System call of process 99859 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:15 devstack quobyte-client[83360]: System call of process 99859 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-84f26563-5e81-4a7d-ad6e-8d4a98f16257" returned: 0 in 0.738s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:15 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-84f26563-5e81-4a7d-ad6e-8d4a98f16257 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Acquiring lock "cinder-999dcb00-3199-460c-856a-b44b51f3f8ca-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8.795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9" returned: 0 in 0.453s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-84f26563-5e81-4a7d-ad6e-8d4a98f16257" returned: 0 in 0.339s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-quobyte-795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9" released by "_delete_snapshot" :: held 2.362s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Lock "cinder-999dcb00-3199-460c-856a-b44b51f3f8ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.137s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:16 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Acquiring lock "cinder-quobyte-7b7c2db6-b4fc-4116-80e2-984cd5592aa6" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-84f26563-5e81-4a7d-ad6e-8d4a98f16257" released by "delete_volume" :: held 1.317s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-quobyte-ee7c6a92-7f5e-4d90-b449-21c1752075c8" released by "delete_snapshot" :: held 2.898s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Lock "cinder-quobyte-7b7c2db6-b4fc-4116-80e2-984cd5592aa6" acquired by "delete_snapshot" :: waited 0.175s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Acquiring lock "cinder-quobyte-999dcb00-3199-460c-856a-b44b51f3f8ca" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Lock "cinder-quobyte-999dcb00-3199-460c-856a-b44b51f3f8ca" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Deleting offline snapshot 999dcb00-3199-460c-856a-b44b51f3f8ca of volume 7b7c2db6-b4fc-4116-80e2-984cd5592aa6 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] snapshot_file for this snap is: volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0a50f6-930b-4700-abf1-65ee54d9b7a8]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:16 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Created reservations ['c1fb7cd1-5ec9-4fc1-9a03-ca56422abc8e', '2bfe6b86-6971-4a01-85d4-5a52d5af72d1', 'be766a23-a7ea-4be8-9b9c-69555b08682c', '330c9962-f9f5-4513-a572-bf099ae70715'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Created reservations ['69f64482-580a-4fda-b49a-4b24d97e35f4', '1942e9b7-288d-4435-b53d-88324aaef6b1', 'b0945ce1-dcc1-4833-942b-40be1f827149', '5e046114-480f-456f-a4fd-ebb037448a8e'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:17 devstack quobyte-client[83360]: System call of process 99869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca" returned: 0 in 0.538s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd532af-0362-4b67-baf5-31481f0a165c]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.510s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "cinder-abe1b752-7295-4747-93ba-57bad63a1156-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "cinder-ee7c6a92-7f5e-4d90-b449-21c1752075c8-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:17 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Deleted volume successfully.
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-abe1b752-7295-4747-93ba-57bad63a1156-delete_volume" acquired by "delete_volume" :: waited 0.114s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:17 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-ee7c6a92-7f5e-4d90-b449-21c1752075c8-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6" returned: 0 in 0.709s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:18 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-50f390b5-48f7-4c17-b62b-43876592f964 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-84f26563-5e81-4a7d-ad6e-8d4a98f16257-delete_volume" released by "delete_volume" :: held 4.375s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:18 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Delete snapshot completed successfully.
Sep 18 22:38:18 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-b943bd7b-d37d-4784-87ae-f7a2b0d6d4b7 tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-795b7be3-b2e8-4a94-9a3c-d6bdcc3f80f9-delete_snapshot" released by "delete_snapshot" :: held 5.704s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:18 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:18 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "cinder-quobyte-ee7c6a92-7f5e-4d90-b449-21c1752075c8" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca" returned: 0 in 0.546s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:18 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:18 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "cinder-quobyte-abe1b752-7295-4747-93ba-57bad63a1156" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:18 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-quobyte-ee7c6a92-7f5e-4d90-b449-21c1752075c8" acquired by "delete_volume" :: waited 0.272s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6.999dcb00-3199-460c-856a-b44b51f3f8ca" returned: 0 in 0.330s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:18 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[722fad71-1410-4a68-83f7-5ccff9bb042a]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:18 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:19 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-abe1b752-7295-4747-93ba-57bad63a1156" acquired by "delete_volume" :: waited 0.295s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:19 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Lock "cinder-quobyte-999dcb00-3199-460c-856a-b44b51f3f8ca" released by "_delete_snapshot" :: held 2.691s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:19 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e50776-62f0-43ad-8c97-ffb19dfcfe22]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-abe1b752-7295-4747-93ba-57bad63a1156 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:19 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Lock "cinder-quobyte-7b7c2db6-b4fc-4116-80e2-984cd5592aa6" released by "delete_snapshot" :: held 2.880s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:19 devstack quobyte-client[83360]: System call of process 99880 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8" returned: 0 in 0.758s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:19 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:19 devstack quobyte-client[83360]: System call of process 99881 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-ee7c6a92-7f5e-4d90-b449-21c1752075c8" returned: 0 in 0.378s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-abe1b752-7295-4747-93ba-57bad63a1156" returned: 0 in 0.913s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-abe1b752-7295-4747-93ba-57bad63a1156 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Created reservations ['d1892c38-ad8e-43a4-9e78-1aff9b61f48e', '86065903-9f06-4ceb-88da-e869f73ec44c', '7f8ece9e-f272-4b89-ba8f-342956d85eeb', '3d285100-25a0-4a12-bb53-b2ef41944215'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-abe1b752-7295-4747-93ba-57bad63a1156" returned: 0 in 0.281s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-quobyte-ee7c6a92-7f5e-4d90-b449-21c1752075c8" released by "delete_volume" :: held 1.632s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-abe1b752-7295-4747-93ba-57bad63a1156" released by "delete_volume" :: held 1.497s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:20 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Delete snapshot completed successfully.
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-74a69495-38d3-42ba-8399-32cdafa6f9ac tempest-CinderUnicodeTest-775395927 None] Lock "cinder-999dcb00-3199-460c-856a-b44b51f3f8ca-delete_snapshot" released by "delete_snapshot" :: held 4.474s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Created reservations ['62df4d22-f5b6-4fe0-a316-88712b2b254f', 'f94116e6-cefe-41e0-bd6c-fd0ae2b3804c', '5c5f88de-c815-4060-8e6d-1c9b2282b6c9', 'beed1df0-c594-44ab-85b9-f9e005c7a693'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Created reservations ['8b9f694f-d3c5-460f-a1fd-8aca866d5456', '42e15148-64ce-41c3-81f7-b2fcf9ce21bc', '1cfe2af1-5cee-4c65-acbf-d7804e5fca15', '1a489b4a-eeb4-41d9-a417-7c6d213bbe60'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:20 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.189s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:21 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Deleted volume successfully.
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "cinder-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "cinder-2f178761-400a-4cd9-9b6f-63a5c3ee712b-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Acquiring lock "cinder-7b7c2db6-b4fc-4116-80e2-984cd5592aa6-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-117956ff-bf1c-4ec2-90a4-0f3c6b96826b tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-ee7c6a92-7f5e-4d90-b449-21c1752075c8-delete_volume" released by "delete_volume" :: held 3.714s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Lock "cinder-7b7c2db6-b4fc-4116-80e2-984cd5592aa6-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.489s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-2f178761-400a-4cd9-9b6f-63a5c3ee712b-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811-delete_volume" acquired by "delete_volume" :: waited 0.210s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:21 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Deleted volume successfully.
Sep 18 22:38:21 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "cinder-quobyte-2f178761-400a-4cd9-9b6f-63a5c3ee712b" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:21 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Acquiring lock "cinder-quobyte-7b7c2db6-b4fc-4116-80e2-984cd5592aa6" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-11e9801d-ff3f-42a5-a8ad-863daf07ca2a tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-abe1b752-7295-4747-93ba-57bad63a1156-delete_volume" released by "delete_volume" :: held 3.998s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:21 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-quobyte-2f178761-400a-4cd9-9b6f-63a5c3ee712b" acquired by "delete_volume" :: waited 0.048s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Lock "cinder-quobyte-7b7c2db6-b4fc-4116-80e2-984cd5592aa6" acquired by "delete_volume" :: waited 0.037s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:22 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[371cf02a-4e9c-4498-b2f4-8058c1a93947]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:22 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[36233ebc-6009-4d57-adde-28fc0f1c4edb]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:22 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "cinder-quobyte-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:22 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811" acquired by "delete_volume" :: waited 0.095s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:22 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7bd990-4e74-4f59-aaba-4182241897bb]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:22 devstack quobyte-client[83360]: System call of process 99890 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b" returned: 0 in 0.767s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:22 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:22 devstack quobyte-client[83360]: System call of process 99892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:22 devstack quobyte-client[83360]: System call of process 99892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6" returned: 0 in 0.887s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-2f178761-400a-4cd9-9b6f-63a5c3ee712b" returned: 0 in 0.239s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:23 devstack quobyte-client[83360]: System call of process 99893 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:23 devstack quobyte-client[83360]: System call of process 99893 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-quobyte-2f178761-400a-4cd9-9b6f-63a5c3ee712b" released by "delete_volume" :: held 1.268s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7b7c2db6-b4fc-4116-80e2-984cd5592aa6" returned: 0 in 0.384s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811" returned: 0 in 0.906s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Lock "cinder-quobyte-7b7c2db6-b4fc-4116-80e2-984cd5592aa6" released by "delete_volume" :: held 1.447s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:23 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811" returned: 0 in 0.328s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:23 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811" released by "delete_volume" :: held 1.421s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:23 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Created reservations ['47b09062-5ccf-4e7a-9c57-9bf7bff657a7', '54edeaa9-5e32-425a-8deb-3b1a791e9744', 'f42a2376-8f9b-41c7-b6ce-0c8e5343ea5c', '711e3a36-b8ad-4045-b60a-2b617450e056'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Created reservations ['8fd6edb1-4dcd-4831-9abe-c65197ba40d1', '79f199e4-fe0f-4fd4-b493-285b9644ab85', '9edcb985-e4a9-4d71-af3c-32bd6a6b8ff7', 'a0f7f462-1f33-4b5d-93eb-07a69c4e9c05'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Created reservations ['56f05dd8-2a0a-4afd-9a68-2a70401e2b00', '012476a2-0ac2-4d44-9ca9-ac87cf56400a', 'd379597b-7b30-4bd6-a002-5dc3b148d6b2', '3227159e-a92d-4afa-87fc-6176885055e4'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.520s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:24 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Deleted volume successfully.
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.378s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:24 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:24 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Deleted volume successfully.
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "cinder-4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7-delete_snapshot" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Acquiring lock "cinder-02c16816-4581-48bc-ba51-d002ae748d3e-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0f16724f-fdd3-4c34-a73b-f2ad2eb28f09 tempest-SnapshotDependencyTests-1178615668 None] Lock "cinder-2f178761-400a-4cd9-9b6f-63a5c3ee712b-delete_volume" released by "delete_volume" :: held 3.613s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.389s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:25 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "cinder-quobyte-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b" by "delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-bd6c545a-c3f6-412b-a406-c32bf83724ef tempest-CinderUnicodeTest-775395927 None] Lock "cinder-7b7c2db6-b4fc-4116-80e2-984cd5592aa6-delete_volume" released by "delete_volume" :: held 3.774s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.369s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:25 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Deleted volume successfully.
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Lock "cinder-02c16816-4581-48bc-ba51-d002ae748d3e-delete_volume" acquired by "delete_volume" :: waited 0.512s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b" acquired by "delete_snapshot" :: waited 0.213s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "cinder-quobyte-4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7" by "_delete_snapshot" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-fd51ca85-4d31-479a-8703-7edd80201dcc tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-4ae4ab44-ae1f-4e4a-bdcd-e5fad440f811-delete_volume" released by "delete_volume" :: held 3.892s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Deleting offline snapshot 4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7 of volume 7cbdfe88-2748-4ea4-8b87-5e17789dfc4b {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] snapshot_file for this snap is: volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7 {{(pid=83342) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b65468-0db7-4421-bdb8-67dabc8aca4a]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:25 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:26 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:26 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Acquiring lock "cinder-quobyte-02c16816-4581-48bc-ba51-d002ae748d3e" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:26 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Lock "cinder-quobyte-02c16816-4581-48bc-ba51-d002ae748d3e" acquired by "delete_volume" :: waited 0.152s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:26 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37f12b9-a8cd-4be1-8b95-fb1ff6c63747]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-02c16816-4581-48bc-ba51-d002ae748d3e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:26 devstack quobyte-client[83360]: System call of process 99906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:26 devstack quobyte-client[83360]: System call of process 99906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7" returned: 0 in 0.717s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:26 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83342) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 18 22:38:26 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[303f534b-22ab-46eb-a79b-dd5c166e6242]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:26 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:26 devstack quobyte-client[83360]: System call of process 99909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-02c16816-4581-48bc-ba51-d002ae748d3e" returned: 0 in 0.545s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-02c16816-4581-48bc-ba51-d002ae748d3e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:27 devstack quobyte-client[83360]: System call of process 99911 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-02c16816-4581-48bc-ba51-d002ae748d3e" returned: 0 in 0.179s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:27 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Lock "cinder-quobyte-02c16816-4581-48bc-ba51-d002ae748d3e" released by "delete_volume" :: held 1.007s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b" returned: 0 in 0.901s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:27 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:27 devstack quobyte-client[83360]: System call of process 99918 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7" returned: 0 in 0.484s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b.4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7" returned: 0 in 0.398s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:28 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7" released by "_delete_snapshot" :: held 2.869s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:28 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b" released by "delete_snapshot" :: held 2.919s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:28 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Created reservations ['419f468a-407c-49d5-84b1-3cc14f7927e7', 'de9d0bc6-99a3-428b-95dc-543fb5dd4ac9', '8b0ee63e-d0d5-4505-aed7-f86613118d12', '7f233ae8-d731-4ad9-bdf3-74285d7e71c4'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:28 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Created reservations ['18778070-a349-4706-98f8-79379064b26d', '7f1f000d-b2ce-48ca-9003-eafba8a32839', '865e5299-8602-42a5-b6ff-4af0e012421c', 'c25034ff-7966-4d1d-be84-23097791c014'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:28 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:28 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:28 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.322s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:29 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:29 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Deleted volume successfully.
Sep 18 22:38:29 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Delete snapshot completed successfully.
Sep 18 22:38:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-9003fa7f-8a9e-4bd9-a809-2fd0c3a1df6f tempest-CinderUnicodeTest-775395927 None] Lock "cinder-02c16816-4581-48bc-ba51-d002ae748d3e-delete_volume" released by "delete_volume" :: held 3.807s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "cinder-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-be8cf9ef-9839-4173-8e9e-fb9200c9aff8 tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-4f8bacf5-2e24-4cc9-a4b9-1cddccb2e8a7-delete_snapshot" released by "delete_snapshot" :: held 4.044s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:29 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "cinder-quobyte-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:29 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b" acquired by "delete_volume" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:29 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd57cfa-ce57-44ee-954d-ebd4a035bb52]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:29 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:30 devstack quobyte-client[83360]: System call of process 99924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:30 devstack quobyte-client[83360]: System call of process 99924 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b" returned: 0 in 0.736s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:30 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b" returned: 0 in 0.248s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:30 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-quobyte-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b" released by "delete_volume" :: held 1.234s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:31 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Created reservations ['79d56e66-6838-48fa-888f-514482dfdc53', '987efb9e-ef51-452c-bcdd-8ea284d8ccda', '0de036fa-4e44-47e8-a703-51c116dd11ce', '26ac2166-84ef-46c2-b8d5-132fa0cc853d'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:31 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:31 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.186s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:31 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:31 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Deleted volume successfully.
Sep 18 22:38:32 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-51c934e5-e967-4c1b-95cb-a53341706fec tempest-CreateVolumesFromSnapshotTest-66960798 None] Lock "cinder-7cbdfe88-2748-4ea4-8b87-5e17789dfc4b-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:35 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:35 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:38:35 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Flow 'volume_create_manager' (520ff5d1-d08e-479b-863e-49eae33c3775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d3609c-ea3b-4798-bd28-ca30700118b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d3609c-ea3b-4798-bd28-ca30700118b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-689179711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f1e8b9-5340-40bf-96eb-7c925c082995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8362656369d249048390c39d1d74a2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:38:36Z,use_quota=True,user_id='7d75a447d6004d268d9f9c99424d1ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eaebacd-a1d7-4dc1-85cd-999ef0d3b6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eaebacd-a1d7-4dc1-85cd-999ef0d3b6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe151c4-f0b0-463f-929b-2b0d2e2c5848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe151c4-f0b0-463f-929b-2b0d2e2c5848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f1e8b9-5340-40bf-96eb-7c925c082995', 'volume_name': 'volume-95f1e8b9-5340-40bf-96eb-7c925c082995', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c41a9f-5843-4255-8ec2-c0ab2ffaee7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c41a9f-5843-4255-8ec2-c0ab2ffaee7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54db6aa-d9c7-4609-a48a-3cb182cd88a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:36 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume 95f1e8b9-5340-40bf-96eb-7c925c082995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f1e8b9-5340-40bf-96eb-7c925c082995', 'volume_size': 1}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:38:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-689179711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f1e8b9-5340-40bf-96eb-7c925c082995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8362656369d249048390c39d1d74a2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:38:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:38:36Z,use_quota=True,user_id='7d75a447d6004d268d9f9c99424d1ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Creating volume 95f1e8b9-5340-40bf-96eb-7c925c082995 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:38:36 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-95f1e8b9-5340-40bf-96eb-7c925c082995 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:36 devstack quobyte-client[83360]: System call of process 99970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:36 devstack quobyte-client[83360]: System call of process 99970 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:36 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=168, name=volume-95f1e8b9-5340-40bf-96eb-7c925c082995, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-95f1e8b9-5340-40bf-96eb-7c925c082995 1073741824" returned: 0 in 0.442s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:36 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-95f1e8b9-5340-40bf-96eb-7c925c082995 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-95f1e8b9-5340-40bf-96eb-7c925c082995" returned: 0 in 0.737s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:37 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] <== create_volume: return (1239ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:38:37 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:37 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54db6aa-d9c7-4609-a48a-3cb182cd88a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f1e8b9-5340-40bf-96eb-7c925c082995', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:37 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb1bffc-7c38-4d94-9843-1d935d6fc112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:37 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume volume-95f1e8b9-5340-40bf-96eb-7c925c082995 (95f1e8b9-5340-40bf-96eb-7c925c082995): created successfully
Sep 18 22:38:37 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb1bffc-7c38-4d94-9843-1d935d6fc112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:37 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Flow 'volume_create_manager' (520ff5d1-d08e-479b-863e-49eae33c3775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:37 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-4655db3d-133a-4168-a045-9971e2fbac2e tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Created volume successfully.
Sep 18 22:38:38 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Flow 'volume_create_manager' (b08e9158-9251-40c3-b7e4-27548c088899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7fe9f6-568b-41f9-9d20-7f79fa8090f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae7fe9f6-568b-41f9-9d20-7f79fa8090f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1443149652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e41cb76-6f39-40fd-aa39-76f0353528b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8362656369d249048390c39d1d74a2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:38:39Z,use_quota=True,user_id='7d75a447d6004d268d9f9c99424d1ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6c2485-9c29-4fea-9f92-8285f6ff3455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c6c2485-9c29-4fea-9f92-8285f6ff3455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3628f226-b9db-4ac4-b370-71ebf63a534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3628f226-b9db-4ac4-b370-71ebf63a534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e41cb76-6f39-40fd-aa39-76f0353528b4', 'volume_name': 'volume-6e41cb76-6f39-40fd-aa39-76f0353528b4', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23a8070-df31-4f94-a57e-397079f7207d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23a8070-df31-4f94-a57e-397079f7207d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb44ff74-192a-48ad-a8f8-901f6824017e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:38 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume 6e41cb76-6f39-40fd-aa39-76f0353528b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e41cb76-6f39-40fd-aa39-76f0353528b4', 'volume_size': 1}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1443149652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e41cb76-6f39-40fd-aa39-76f0353528b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8362656369d249048390c39d1d74a2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:38:39Z,use_quota=True,user_id='7d75a447d6004d268d9f9c99424d1ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Creating volume 6e41cb76-6f39-40fd-aa39-76f0353528b4 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:38:38 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:38:38 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e41cb76-6f39-40fd-aa39-76f0353528b4 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:39 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=169, name=volume-6e41cb76-6f39-40fd-aa39-76f0353528b4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:38:39 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:39 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:38:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Flow 'volume_create_manager' (de558e1c-6806-44d0-92ed-a2dd343acb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:39 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beacbbb6-9982-4677-8897-762d60379967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e41cb76-6f39-40fd-aa39-76f0353528b4 1073741824" returned: 0 in 0.721s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:39 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e41cb76-6f39-40fd-aa39-76f0353528b4 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beacbbb6-9982-4677-8897-762d60379967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1008623550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8362656369d249048390c39d1d74a2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:38:39Z,use_quota=True,user_id='7d75a447d6004d268d9f9c99424d1ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321f880e-3975-43ac-9e27-6eb8fe5cd507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321f880e-3975-43ac-9e27-6eb8fe5cd507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8e0959-348b-4360-8d18-f70264a0c2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8e0959-348b-4360-8d18-f70264a0c2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44', 'volume_name': 'volume-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1db76dc-3a7b-47cc-ad3f-360ae8419ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1db76dc-3a7b-47cc-ad3f-360ae8419ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec1aad0-25f0-4002-a0ee-e6b87881bb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:40 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume 1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44', 'volume_size': 1}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e41cb76-6f39-40fd-aa39-76f0353528b4" returned: 0 in 0.694s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] <== create_volume: return (1437ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.090s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1008623550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8362656369d249048390c39d1d74a2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:38:39Z,use_quota=True,user_id='7d75a447d6004d268d9f9c99424d1ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Creating volume 1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:38:40 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:40 devstack quobyte-client[83360]: System call of process 99979 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:40 devstack quobyte-client[83360]: System call of process 99979 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:40 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=170, name=volume-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb44ff74-192a-48ad-a8f8-901f6824017e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e41cb76-6f39-40fd-aa39-76f0353528b4', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:40 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e191c85-8774-4a33-aaf6-d7ae22f94cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:41 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Flow 'volume_create_manager' (c3bdb485-0e34-4154-8ff3-08d5ff1233af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416eb38f-bebb-42f8-ba9f-59d9eacfcc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:41 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume volume-6e41cb76-6f39-40fd-aa39-76f0353528b4 (6e41cb76-6f39-40fd-aa39-76f0353528b4): created successfully
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e191c85-8774-4a33-aaf6-d7ae22f94cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Flow 'volume_create_manager' (b08e9158-9251-40c3-b7e4-27548c088899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:41 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-1f6cf16f-86f9-4faf-9968-6ee36f6e8cfa tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Created volume successfully.
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44 1073741824" returned: 0 in 0.905s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416eb38f-bebb-42f8-ba9f-59d9eacfcc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1445342213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5039c8-2b18-477f-9fe6-e0e09040c417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8362656369d249048390c39d1d74a2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:38:40Z,use_quota=True,user_id='7d75a447d6004d268d9f9c99424d1ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87730896-55e1-46e4-b175-41836dad5119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87730896-55e1-46e4-b175-41836dad5119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d829d9-7fe4-4425-9ef3-03acdb267374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d829d9-7fe4-4425-9ef3-03acdb267374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a5039c8-2b18-477f-9fe6-e0e09040c417', 'volume_name': 'volume-3a5039c8-2b18-477f-9fe6-e0e09040c417', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901b9340-851c-4061-bf6a-0a93edf09dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901b9340-851c-4061-bf6a-0a93edf09dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef60bec5-b39d-4082-8352-b3a92bd7021e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:41 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume 3a5039c8-2b18-477f-9fe6-e0e09040c417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a5039c8-2b18-477f-9fe6-e0e09040c417', 'volume_size': 1}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:41 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Flow 'volume_create_manager' (769eeb1d-95e5-47f5-81d4-c3de4c7ead55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356ef1cd-e458-426a-89d9-b79ac3e818cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:41 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.flows.manager.create_volume [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83342) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Flow 'volume_create_manager' (81401e04-1eb9-49d8-8aae-3cbe8b2a2c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e3ed46-a9ea-43e4-8327-a7770b2a790a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44" returned: 0 in 0.612s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] <== create_volume: return (1542ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.375s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1445342213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5039c8-2b18-477f-9fe6-e0e09040c417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8362656369d249048390c39d1d74a2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:38:40Z,use_quota=True,user_id='7d75a447d6004d268d9f9c99424d1ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Creating volume 3a5039c8-2b18-477f-9fe6-e0e09040c417 {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:38:41 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:38:41 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3a5039c8-2b18-477f-9fe6-e0e09040c417 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:42 devstack quobyte-client[83360]: System call of process 99983 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:42 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=171, name=volume-3a5039c8-2b18-477f-9fe6-e0e09040c417, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356ef1cd-e458-426a-89d9-b79ac3e818cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095427559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13b62d9-dc71-4047-abe0-31b45bdfd99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8362656369d249048390c39d1d74a2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:38:41Z,use_quota=True,user_id='7d75a447d6004d268d9f9c99424d1ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf78b0b-6f5f-453b-9e96-50433a7eaf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf78b0b-6f5f-453b-9e96-50433a7eaf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd307cbb-6924-40a3-b6ab-a46c569c8a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd307cbb-6924-40a3-b6ab-a46c569c8a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c13b62d9-dc71-4047-abe0-31b45bdfd99b', 'volume_name': 'volume-c13b62d9-dc71-4047-abe0-31b45bdfd99b', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d756fa-6ec9-47bc-b13a-34e6e53e325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d756fa-6ec9-47bc-b13a-34e6e53e325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7caa002-bd00-4cdd-a219-319682851dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:42 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume c13b62d9-dc71-4047-abe0-31b45bdfd99b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c13b62d9-dc71-4047-abe0-31b45bdfd99b', 'volume_size': 1}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec1aad0-25f0-4002-a0ee-e6b87881bb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60784943-2f4b-475f-b97f-a575971b7bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e3ed46-a9ea-43e4-8327-a7770b2a790a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-382607417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba93bf5-b69e-4887-acdd-3b087665951e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8362656369d249048390c39d1d74a2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:38:40Z,use_quota=True,user_id='7d75a447d6004d268d9f9c99424d1ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e676f62f-9950-4486-9d8c-5c4721a6434a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e676f62f-9950-4486-9d8c-5c4721a6434a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b0b43b-3112-46cc-b3e5-4bde37540eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b0b43b-3112-46cc-b3e5-4bde37540eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba93bf5-b69e-4887-acdd-3b087665951e', 'volume_name': 'volume-6ba93bf5-b69e-4887-acdd-3b087665951e', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0858f0-b03b-4093-9d4f-b22593bf6c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d0858f0-b03b-4093-9d4f-b22593bf6c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74692dc-cc84-4cbf-b21a-11ab8d38ce1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:42 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume 6ba93bf5-b69e-4887-acdd-3b087665951e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba93bf5-b69e-4887-acdd-3b087665951e', 'volume_size': 1}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:42 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume volume-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44 (1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44): created successfully
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60784943-2f4b-475f-b97f-a575971b7bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Flow 'volume_create_manager' (de558e1c-6806-44d0-92ed-a2dd343acb1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3a5039c8-2b18-477f-9fe6-e0e09040c417 1073741824" returned: 0 in 0.596s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3a5039c8-2b18-477f-9fe6-e0e09040c417 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:42 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-5fbb954d-318b-42f9-8d5e-52c383a3d3cf tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Created volume successfully.
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3a5039c8-2b18-477f-9fe6-e0e09040c417" returned: 0 in 0.277s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] <== create_volume: return (905ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.500s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095427559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13b62d9-dc71-4047-abe0-31b45bdfd99b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8362656369d249048390c39d1d74a2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:38:41Z,use_quota=True,user_id='7d75a447d6004d268d9f9c99424d1ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Creating volume c13b62d9-dc71-4047-abe0-31b45bdfd99b {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:38:42 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:38:42 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c13b62d9-dc71-4047-abe0-31b45bdfd99b 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:42 devstack quobyte-client[83360]: System call of process 99988 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:42 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=172, name=volume-c13b62d9-dc71-4047-abe0-31b45bdfd99b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef60bec5-b39d-4082-8352-b3a92bd7021e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5039c8-2b18-477f-9fe6-e0e09040c417', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae1c71c-3f23-4932-8225-713a8f530394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c13b62d9-dc71-4047-abe0-31b45bdfd99b 1073741824" returned: 0 in 0.426s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c13b62d9-dc71-4047-abe0-31b45bdfd99b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:43 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume volume-3a5039c8-2b18-477f-9fe6-e0e09040c417 (3a5039c8-2b18-477f-9fe6-e0e09040c417): created successfully
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae1c71c-3f23-4932-8225-713a8f530394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Flow 'volume_create_manager' (c3bdb485-0e34-4154-8ff3-08d5ff1233af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c13b62d9-dc71-4047-abe0-31b45bdfd99b" returned: 0 in 0.305s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] <== create_volume: return (760ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.135s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f905f50d9f0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-18T20:38:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-382607417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba93bf5-b69e-4887-acdd-3b087665951e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8362656369d249048390c39d1d74a2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-18T20:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-18T20:38:40Z,use_quota=True,user_id='7d75a447d6004d268d9f9c99424d1ed7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279d2e90-c310-4056-8236-7ee73b14dbd2),volume_type_id=279d2e90-c310-4056-8236-7ee73b14dbd2)}" {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.remotefs [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Creating volume 6ba93bf5-b69e-4887-acdd-3b087665951e {{(pid=83342) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Selected 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e as target Quobyte volume. {{(pid=83342) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 18 22:38:43 devstack cinder-volume[83342]: INFO cinder.volume.drivers.remotefs [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] casted to 10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6ba93bf5-b69e-4887-acdd-3b087665951e 1073741824 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:43 devstack quobyte-client[83360]: System call of process 99992 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 18 22:38:43 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-2752c500-6974-4c90-a973-7cb80f2517ff tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Created volume successfully.
Sep 18 22:38:43 devstack quobyte-client[83360]: The server volume:6bbb64ce-4885-4d85-bbe9-caae09d0bea9@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=6bbb64ce-4885-4d85-bbe9-caae09d0bea9, inode=173, name=volume-6ba93bf5-b69e-4887-acdd-3b087665951e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.85), requestorAccessMask=0
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7caa002-bd00-4cdd-a219-319682851dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c13b62d9-dc71-4047-abe0-31b45bdfd99b', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:43 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e55f43-383c-4ae0-9194-c7581b5dcec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6ba93bf5-b69e-4887-acdd-3b087665951e 1073741824" returned: 0 in 0.454s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6ba93bf5-b69e-4887-acdd-3b087665951e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:44 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume volume-c13b62d9-dc71-4047-abe0-31b45bdfd99b (c13b62d9-dc71-4047-abe0-31b45bdfd99b): created successfully
Sep 18 22:38:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e55f43-383c-4ae0-9194-c7581b5dcec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Flow 'volume_create_manager' (769eeb1d-95e5-47f5-81d4-c3de4c7ead55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6ba93bf5-b69e-4887-acdd-3b087665951e" returned: 0 in 0.358s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:44 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] <== create_volume: return (842ms) {'provider_location': '10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'} {{(pid=83342) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Sep 18 22:38:44 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:44 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-5faefd25-84ec-49e0-b911-101213489c2c tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Created volume successfully.
Sep 18 22:38:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74692dc-cc84-4cbf-b21a-11ab8d38ce1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba93bf5-b69e-4887-acdd-3b087665951e', 'volume_size': 1}' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70145f7-163e-4c4c-bbde-982ac16ebe5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 18 22:38:44 devstack cinder-volume[83342]: INFO cinder.volume.flows.manager.create_volume [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume volume-6ba93bf5-b69e-4887-acdd-3b087665951e (6ba93bf5-b69e-4887-acdd-3b087665951e): created successfully
Sep 18 22:38:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f70145f7-163e-4c4c-bbde-982ac16ebe5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83342) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 18 22:38:44 devstack cinder-volume[83342]: DEBUG cinder.volume.manager [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Flow 'volume_create_manager' (81401e04-1eb9-49d8-8aae-3cbe8b2a2c5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83342) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 18 22:38:44 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-a868b575-e098-49a1-ae16-e9e8a2160104 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Created volume successfully.
Sep 18 22:38:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "cinder-c13b62d9-dc71-4047-abe0-31b45bdfd99b-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-c13b62d9-dc71-4047-abe0-31b45bdfd99b-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:45 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "cinder-quobyte-c13b62d9-dc71-4047-abe0-31b45bdfd99b" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:45 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-quobyte-c13b62d9-dc71-4047-abe0-31b45bdfd99b" acquired by "delete_volume" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:45 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b7d727-9088-405a-9e29-2d3c09a4368a]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:45 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c13b62d9-dc71-4047-abe0-31b45bdfd99b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c13b62d9-dc71-4047-abe0-31b45bdfd99b" returned: 0 in 0.404s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c13b62d9-dc71-4047-abe0-31b45bdfd99b {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:46 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-c13b62d9-dc71-4047-abe0-31b45bdfd99b" returned: 0 in 0.097s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:46 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-quobyte-c13b62d9-dc71-4047-abe0-31b45bdfd99b" released by "delete_volume" :: held 0.694s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:46 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Created reservations ['205d1c67-0514-423f-90bb-fd54b4e7dafc', '3ba610ce-1fc4-4f3e-9502-60a7507c8b75', 'c3efcdde-e87e-480e-8dca-09e1f6ee6dab', 'f0779f90-4b30-4035-bf98-2f32657c2e4c'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG oslo_service.periodic_task [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.214s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:47 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Deleted volume successfully.
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.331s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-ff44dc82-506a-4ff3-aad2-c07d53dce779 None None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-0567475a-f0db-47bc-afd3-c205e8a0d830 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-c13b62d9-dc71-4047-abe0-31b45bdfd99b-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "cinder-6ba93bf5-b69e-4887-acdd-3b087665951e-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:47 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-6ba93bf5-b69e-4887-acdd-3b087665951e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:48 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:48 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "cinder-quobyte-6ba93bf5-b69e-4887-acdd-3b087665951e" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:48 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-quobyte-6ba93bf5-b69e-4887-acdd-3b087665951e" acquired by "delete_volume" :: waited 0.013s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:48 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[900bef7b-a33a-4bdc-a08a-b08b363630b8]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6ba93bf5-b69e-4887-acdd-3b087665951e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6ba93bf5-b69e-4887-acdd-3b087665951e" returned: 0 in 0.412s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6ba93bf5-b69e-4887-acdd-3b087665951e {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:48 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6ba93bf5-b69e-4887-acdd-3b087665951e" returned: 0 in 0.101s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:48 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-quobyte-6ba93bf5-b69e-4887-acdd-3b087665951e" released by "delete_volume" :: held 0.688s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:49 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Created reservations ['bff5d429-0f25-42af-9c72-812eaac6a09e', '041c180f-1407-4fc7-a341-b5730bc89579', '38a58a00-2811-4661-8ff3-e687e2eed926', '39e51665-9985-4a33-a9b4-1f6d56aa4090'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:49 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:49 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.091s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:49 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:49 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Deleted volume successfully.
Sep 18 22:38:49 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-c71df3ef-049e-402e-b93d-8be3ea73c056 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-6ba93bf5-b69e-4887-acdd-3b087665951e-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:50 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "cinder-3a5039c8-2b18-477f-9fe6-e0e09040c417-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:50 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-3a5039c8-2b18-477f-9fe6-e0e09040c417-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:50 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:50 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "cinder-quobyte-3a5039c8-2b18-477f-9fe6-e0e09040c417" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:50 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-quobyte-3a5039c8-2b18-477f-9fe6-e0e09040c417" acquired by "delete_volume" :: waited 0.012s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:50 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3a65cd-6b70-4ec7-85ef-2a8454d64305]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3a5039c8-2b18-477f-9fe6-e0e09040c417 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3a5039c8-2b18-477f-9fe6-e0e09040c417" returned: 0 in 0.405s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3a5039c8-2b18-477f-9fe6-e0e09040c417 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:50 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-3a5039c8-2b18-477f-9fe6-e0e09040c417" returned: 0 in 0.113s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:51 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-quobyte-3a5039c8-2b18-477f-9fe6-e0e09040c417" released by "delete_volume" :: held 0.674s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:51 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Created reservations ['b8ce2525-c30c-4314-bbdc-c8f2c3bb35a2', 'd70dff26-03e5-4bae-8501-c143697e780b', 'a9d6bb85-9fed-49cc-ac3c-b6f8da867d2d', '88faff1c-12f4-4b91-80f4-aee72fb62682'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:51 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:51 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:51 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.106s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:51 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:51 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Deleted volume successfully.
Sep 18 22:38:51 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-2990c48c-4781-4e24-a22f-c9811f78a054 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-3a5039c8-2b18-477f-9fe6-e0e09040c417-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "cinder-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:52 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "cinder-quobyte-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:52 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-quobyte-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:52 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad27a47-a2c3-47e6-8227-48cfa261f3cf]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:52 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44" returned: 0 in 0.407s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44" returned: 0 in 0.090s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:53 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-quobyte-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44" released by "delete_volume" :: held 0.664s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:53 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Created reservations ['6c012769-74a7-4bfd-9e95-711bd168600e', '25d0d721-1164-44e0-987c-70595002eb9b', '875928a7-7dce-47d3-a09b-f7c1b5afc99a', 'dfb8b47c-d6ab-4a95-9760-af5daae60242'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:53 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:53 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.082s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:53 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:53 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Deleted volume successfully.
Sep 18 22:38:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-05bda8c9-e475-4cfe-8af1-9140b4ac4da0 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-1759b566-a1d4-4e91-9a9a-8ed7bfa8ea44-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "cinder-6e41cb76-6f39-40fd-aa39-76f0353528b4-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-6e41cb76-6f39-40fd-aa39-76f0353528b4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:54 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "cinder-quobyte-6e41cb76-6f39-40fd-aa39-76f0353528b4" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:54 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-quobyte-6e41cb76-6f39-40fd-aa39-76f0353528b4" acquired by "delete_volume" :: waited 0.014s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:54 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4205b406-8609-4598-b166-29d409d0e52c]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:54 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e41cb76-6f39-40fd-aa39-76f0353528b4 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e41cb76-6f39-40fd-aa39-76f0353528b4" returned: 0 in 0.388s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e41cb76-6f39-40fd-aa39-76f0353528b4 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-6e41cb76-6f39-40fd-aa39-76f0353528b4" returned: 0 in 0.110s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:55 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-quobyte-6e41cb76-6f39-40fd-aa39-76f0353528b4" released by "delete_volume" :: held 0.664s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:55 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Created reservations ['389899d6-a8c3-4a97-b0a7-9b57437e0024', 'fcfdb9a2-74b5-4825-98e3-4e107689ecb3', '2b315f55-413f-4e6f-952b-25aaadda79de', '92a8fea6-1107-4fa6-a60c-5bfe54e62987'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:55 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:55 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:55 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:56 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.106s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:56 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:56 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Deleted volume successfully.
Sep 18 22:38:56 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-1f489484-35cb-46a8-87fd-7c52d3ef7e87 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-6e41cb76-6f39-40fd-aa39-76f0353528b4-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "cinder-95f1e8b9-5340-40bf-96eb-7c925c082995-delete_volume" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-95f1e8b9-5340-40bf-96eb-7c925c082995-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:57 devstack cinder-volume[83342]: WARNING cinder.volume.volume_utils [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 18 22:38:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "cinder-quobyte-95f1e8b9-5340-40bf-96eb-7c925c082995" by "delete_volume" {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 18 22:38:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-quobyte-95f1e8b9-5340-40bf-96eb-7c925c082995" acquired by "delete_volume" :: waited 0.011s {{(pid=83342) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 18 22:38:57 devstack cinder-volume[83342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d8c3c2-df52-4cc6-99bd-c71f4a66266e]: (4, 'qcow2') {{(pid=84431) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 18 22:38:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-95f1e8b9-5340-40bf-96eb-7c925c082995 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-95f1e8b9-5340-40bf-96eb-7c925c082995" returned: 0 in 0.391s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-95f1e8b9-5340-40bf-96eb-7c925c082995 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:57 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "rm -f /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3/volume-95f1e8b9-5340-40bf-96eb-7c925c082995" returned: 0 in 0.097s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:57 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-quobyte-95f1e8b9-5340-40bf-96eb-7c925c082995" released by "delete_volume" :: held 0.650s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:38:58 devstack cinder-volume[83342]: DEBUG cinder.quota [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Created reservations ['b4f99618-0ca4-4964-9376-7cb4767d53d6', '23bb1561-e07c-42ab-bb90-9cd91adf460f', '6201f177-eea6-445b-b5da-59570fb3327b', '460c4fe2-41d2-4f81-890a-e147d2ac21cd'] {{(pid=83342) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 18 22:38:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 18 22:38:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 18 22:38:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e': None} {{(pid=83342) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 18 22:38:58 devstack cinder-volume[83342]: DEBUG cinder.volume.drivers.quobyte [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Available shares ['10.10.41.181/cinder-vol-bf2e6889-08e9-45fc-8968-4b9566d27b7e'] {{(pid=83342) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 18 22:38:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.lockutils [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 18 22:38:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3 {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 18 22:38:58 devstack cinder-volume[83342]: DEBUG oslo_concurrency.processutils [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/fed5b235154fae16b23c0316f84841c3" returned: 0 in 0.091s {{(pid=83342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 18 22:38:58 devstack cinder-volume[83342]: DEBUG cinder.manager [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Notifying Schedulers of capabilities ... {{(pid=83342) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 18 22:38:58 devstack cinder-volume[83342]: INFO cinder.volume.manager [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Deleted volume successfully.
Sep 18 22:38:58 devstack cinder-volume[83342]: DEBUG cinder.coordination [None req-60af2c38-8305-4402-8a9a-7b5b18774c65 tempest-CreateVolumesFromSourceVolumeTest-1583799412 None] Lock "cinder-95f1e8b9-5340-40bf-96eb-7c925c082995-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=83342) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 18 22:39:08 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:SELECT=99,cinder:INSERT=41,cinder:UPDATE=162,cinder:DELETE=9 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 18 22:39:08 devstack cinder-volume[83342]: DEBUG dbcounter [-] [83342] Writing DB stats cinder:INSERT=35,cinder:UPDATE=154,cinder:SELECT=99,cinder:DELETE=15 {{(pid=83342) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}